Sep 18 11:19:11.402278 ip-10-0-140-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 11:19:11.402292 ip-10-0-140-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 11:19:11.402302 ip-10-0-140-158 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 11:19:11.402512 ip-10-0-140-158 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 11:19:22.684724 ip-10-0-140-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 11:19:22.684739 ip-10-0-140-158 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bbcc12cee90147129f163b45d2a9ef5a -- Sep 18 11:21:17.625278 ip-10-0-140-158 systemd[1]: Starting Kubernetes Kubelet... Sep 18 11:21:18.051359 ip-10-0-140-158 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 11:21:18.051359 ip-10-0-140-158 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 11:21:18.051359 ip-10-0-140-158 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 11:21:18.051359 ip-10-0-140-158 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 11:21:18.051359 ip-10-0-140-158 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 11:21:18.053591 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.053515 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 11:21:18.058301 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058286 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.058301 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058301 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058305 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058310 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058313 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058316 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058319 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058322 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058324 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058327 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058329 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058337 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058340 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058343 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058345 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058348 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058351 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058353 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058356 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058358 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058361 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.058363 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058363 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058366 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058369 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058371 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058374 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058377 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058380 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058382 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058385 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058387 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058389 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058394 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058397 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058400 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058403 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058405 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058408 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058410 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058412 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.058824 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058415 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058418 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058420 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058424 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058426 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058429 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058431 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058433 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058436 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058438 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058440 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058443 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058445 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058447 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058450 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058453 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058455 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058460 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058464 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058467 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.059293 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058469 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058472 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058475 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058478 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058481 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058483 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058486 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058489 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058491 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058494 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058496 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058499 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058501 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058504 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058508 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058510 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058513 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058515 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058517 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058520 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.059783 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058522 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058525 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058528 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058530 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058534 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058536 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058538 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058541 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058545 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058549 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058552 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058555 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058558 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058560 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058563 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058565 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058567 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058570 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.058572 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.060273 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059228 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059234 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059239 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059243 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059246 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059249 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059252 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059255 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059257 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059262 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059266 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059269 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059273 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059275 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059278 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059281 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059283 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059286 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059288 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.060720 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059291 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059294 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059297 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059300 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059302 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059305 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059308 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059310 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059313 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059315 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059318 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059320 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059322 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059325 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059328 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059330 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059333 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059336 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059338 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059341 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.061197 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059343 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059346 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059349 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059351 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059354 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059356 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059359 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059361 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059364 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059367 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059370 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059372 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059375 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059378 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059381 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059387 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059390 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059392 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059395 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.061679 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059398 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059400 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059403 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059405 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059408 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059410 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059413 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059415 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059418 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059420 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059423 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059426 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059430 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059433 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059436 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059439 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059441 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059445 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059447 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.062422 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059452 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059456 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059458 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059461 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059463 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059466 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059468 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059471 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059474 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059476 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059479 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059481 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059483 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059486 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059488 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059491 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059493 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059496 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059498 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059501 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.063195 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059503 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059845 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059850 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059852 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059855 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059857 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059861 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059866 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059869 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059872 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059874 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059877 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059880 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059884 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059887 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059889 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059892 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059894 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059897 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.063796 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059899 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059902 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059904 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059907 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059909 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059914 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059916 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059919 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059921 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059923 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059926 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059928 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059930 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059933 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059935 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059938 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059940 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059942 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059945 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059947 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.064290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059950 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059952 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059955 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059957 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059960 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059962 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059965 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059967 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059972 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059975 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059977 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059979 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.059997 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060000 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060003 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060005 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060008 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060011 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060013 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.064788 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060016 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060019 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060021 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060024 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060026 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060028 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060031 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060033 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060036 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060038 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060041 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060043 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060046 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060048 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060053 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060056 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060060 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060063 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060067 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060070 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.065284 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060072 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060075 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060077 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060080 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060082 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060085 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060087 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060090 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060092 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060095 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060098 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060102 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060104 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060107 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060109 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060112 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060114 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060117 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060120 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060122 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.065765 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060124 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060192 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060229 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060235 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060239 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060242 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060247 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060252 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060256 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060259 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060263 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060266 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060269 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060272 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060275 2579 flags.go:64] FLAG: --cgroup-root="" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060277 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060280 2579 flags.go:64] FLAG: --client-ca-file="" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060283 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060286 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060290 2579 flags.go:64] FLAG: --cluster-domain="" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060293 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060296 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060298 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060301 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 11:21:18.066313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060305 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060308 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060311 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060314 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060316 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060319 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060322 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060325 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060328 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060332 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060335 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060337 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060340 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060343 2579 flags.go:64] FLAG: --enable-server="true" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060347 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060350 2579 flags.go:64] FLAG: --event-burst="100" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060353 2579 flags.go:64] FLAG: --event-qps="50" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060356 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060361 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060364 2579 flags.go:64] FLAG: --eviction-hard="" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060367 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060370 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060373 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060375 2579 flags.go:64] FLAG: --eviction-soft="" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060378 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 11:21:18.066925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060381 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060383 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060386 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060389 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060391 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060394 2579 flags.go:64] FLAG: --feature-gates="" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060397 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060400 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060403 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060406 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060409 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060412 2579 flags.go:64] FLAG: --help="false" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060415 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060418 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060421 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060423 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060426 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060430 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060433 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060436 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060438 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060442 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060445 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060448 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 11:21:18.067589 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060451 2579 flags.go:64] FLAG: --kube-reserved="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060455 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060458 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060462 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060464 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060467 2579 flags.go:64] FLAG: --lock-file="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060469 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060472 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060475 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060480 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060483 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060486 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060488 2579 flags.go:64] FLAG: --logging-format="text" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060491 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060494 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060497 2579 flags.go:64] FLAG: --manifest-url="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060499 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060503 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060506 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060510 2579 flags.go:64] FLAG: --max-pods="110" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060513 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060516 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060518 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060521 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060524 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 11:21:18.068211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060527 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060529 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060536 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060539 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060543 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060545 2579 flags.go:64] FLAG: --pod-cidr="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060548 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060553 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060556 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060561 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060563 2579 flags.go:64] FLAG: --port="10250" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060566 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060569 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0932971c4a10fa7c2" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060572 2579 flags.go:64] FLAG: --qos-reserved="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060575 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060577 2579 flags.go:64] FLAG: --register-node="true" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060580 2579 flags.go:64] FLAG: --register-with-taints="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060584 2579 flags.go:64] FLAG: --registry-burst="10" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060587 2579 flags.go:64] FLAG: --registry-qps="5" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060589 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060592 2579 flags.go:64] FLAG: --reserved-memory="" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060595 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060598 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060601 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060603 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 11:21:18.068898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060606 2579 flags.go:64] FLAG: --runonce="false" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060609 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060612 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060614 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060617 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060620 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060623 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060626 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060629 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060632 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060635 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060640 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060642 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060645 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060648 2579 flags.go:64] FLAG: --system-cgroups="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060650 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060659 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060662 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060665 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060669 2579 flags.go:64] FLAG: --tls-min-version="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060672 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060674 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060677 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060680 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060682 2579 flags.go:64] FLAG: --v="2" Sep 18 11:21:18.069552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060686 2579 flags.go:64] FLAG: --version="false" Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060690 2579 flags.go:64] FLAG: --vmodule="" Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060693 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.060696 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060806 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060809 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060812 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060815 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060818 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060820 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060823 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060826 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060828 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060831 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060834 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060838 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060841 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060844 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060847 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060850 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.070243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060852 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060855 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060858 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060862 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060865 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060867 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060870 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060872 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060875 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060878 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060880 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060882 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060885 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060887 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060890 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060892 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060895 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060897 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060900 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060902 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.070722 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060905 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060907 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060910 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060912 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060915 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060917 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060919 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060922 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060924 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060928 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060931 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060934 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060937 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060940 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060943 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060947 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060950 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060953 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060955 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.071278 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060958 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060961 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060963 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060965 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060968 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060970 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060973 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060975 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060978 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060980 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.060998 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061001 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061003 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061006 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061009 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061011 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061013 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061016 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061018 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061021 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.071748 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061024 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061026 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061029 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061031 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061034 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061036 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061039 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061041 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061045 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061047 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061051 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061055 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061058 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061061 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061064 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061066 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061069 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061071 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061073 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.072271 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061076 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061078 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061081 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061083 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.061086 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.061807 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.070494 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.070508 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.071273 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.071281 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071334 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071338 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071341 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071345 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.072727 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071348 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071351 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071354 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071357 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071359 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071362 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071364 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071367 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071370 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071373 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071375 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071378 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071381 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071383 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071386 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071389 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071391 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071394 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071396 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071399 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.073085 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071401 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071404 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071407 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071410 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071413 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071416 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071419 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071423 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071426 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071430 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071432 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071436 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071439 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071442 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071444 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071447 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071449 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071452 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071455 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071457 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.073566 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071460 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071462 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071465 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071468 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071470 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071473 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071476 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071478 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071481 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071483 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071486 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071489 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071491 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071493 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071497 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071501 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071504 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071507 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071509 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071512 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.074125 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071515 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071517 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071520 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071522 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071525 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071527 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071529 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071532 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071534 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071537 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071539 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071542 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071544 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071547 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071549 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071552 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071554 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071557 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071560 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.074675 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071562 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071565 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071567 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071570 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071573 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071575 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071577 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071580 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071583 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071587 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071590 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071593 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071596 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071599 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071601 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.075152 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071604 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.071610 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071715 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071719 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071722 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071725 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071727 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071730 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071732 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071735 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071738 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071741 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071743 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071746 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071749 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 11:21:18.075521 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071752 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071754 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071757 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071760 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071762 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071765 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071768 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071770 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071772 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071775 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071777 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071780 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071782 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071786 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071790 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071793 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071795 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071798 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071801 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 11:21:18.075889 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071803 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071806 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071809 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071811 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071814 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071816 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071818 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071821 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071824 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071826 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071829 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071832 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071835 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071837 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071840 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071842 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071845 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071847 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071850 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071852 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 11:21:18.076362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071855 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071857 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071860 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071862 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071865 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071867 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071870 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071872 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071874 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071877 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071879 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071882 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071884 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071887 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071889 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071891 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071894 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071896 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071899 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071902 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 11:21:18.076853 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071905 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071908 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071911 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071913 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071916 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071919 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071921 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071924 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071926 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071929 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071931 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071933 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071936 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071938 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071941 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071943 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071946 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071950 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071953 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071956 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 11:21:18.077337 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071958 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071961 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071964 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071966 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071968 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071971 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:18.071973 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.071978 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.072086 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.074156 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.075218 2579 server.go:1019] "Starting client certificate rotation" Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.075325 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 11:21:18.077828 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.075366 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 11:21:18.078183 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.078139 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 11:21:18.079190 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.079172 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 11:21:18.090460 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.090437 2579 log.go:25] "Validated CRI v1 runtime API" Sep 18 11:21:18.092352 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.092333 2579 log.go:25] "Validated CRI v1 image API" Sep 18 11:21:18.094172 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.094152 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 11:21:18.097080 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.097058 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a9eea1ba-2e9b-415c-8ffc-4f9416dd3833:/dev/nvme0n1p4 bcb152c3-a303-46cc-a574-9163c3a3e626:/dev/nvme0n1p3] Sep 18 11:21:18.097160 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.097078 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 11:21:18.102227 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.102116 2579 manager.go:216] Machine: {Timestamp:2026-09-18 11:21:18.100598602 +0000 UTC m=+0.348502900 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099545 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ef3b5448ea8ec7e40947ca2cc157 SystemUUID:ec25ef3b-5448-ea8e-c7e4-0947ca2cc157 BootID:bbcc12ce-e901-4712-9f16-3b45d2a9ef5a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d6:3f:ba:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d6:3f:ba:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:78:f3:b2:64:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 11:21:18.102227 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.102219 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 11:21:18.102402 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.102319 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 11:21:18.105604 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.105576 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 11:21:18.105686 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.105621 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 11:21:18.105761 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.105603 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 11:21:18.106411 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.106400 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 11:21:18.106452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.106414 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 11:21:18.106452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.106422 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 11:21:18.107295 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.107283 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 11:21:18.107361 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.107353 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 11:21:18.110689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110679 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 18 11:21:18.110807 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110798 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 11:21:18.110836 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110827 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 18 11:21:18.110836 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110836 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 11:21:18.110886 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110850 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 11:21:18.110886 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110860 2579 kubelet.go:398] "Adding apiserver pod source" Sep 18 11:21:18.110886 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.110869 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 11:21:18.111238 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.111227 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 11:21:18.111273 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.111246 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 11:21:18.113528 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.113509 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 11:21:18.116165 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.116148 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 11:21:18.116241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.116186 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 11:21:18.117553 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117538 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117559 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117568 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117575 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117588 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117597 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117615 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117623 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 11:21:18.117634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117633 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 11:21:18.117871 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117642 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 11:21:18.117871 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117655 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 11:21:18.117871 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.117663 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 11:21:18.118481 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.118469 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 11:21:18.118536 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.118484 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 11:21:18.121756 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.121737 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 11:21:18.121854 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.121738 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 11:21:18.121955 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.121932 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 11:21:18.122405 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.122389 2579 server.go:1268] "Started kubelet" Sep 18 11:21:18.122462 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.122421 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 11:21:18.122553 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.122504 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 11:21:18.122654 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.122595 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 11:21:18.123733 ip-10-0-140-158 systemd[1]: Started Kubernetes Kubelet. Sep 18 11:21:18.124193 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.124066 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 11:21:18.129068 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.129041 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 11:21:18.129369 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.129354 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 18 11:21:18.133117 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.131964 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-158.ec2.internal.18d66663302a65a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-158.ec2.internal,UID:ip-10-0-140-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-158.ec2.internal,},FirstTimestamp:2026-09-18 11:21:18.122231205 +0000 UTC m=+0.370135503,LastTimestamp:2026-09-18 11:21:18.122231205 +0000 UTC m=+0.370135503,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-158.ec2.internal,}" Sep 18 11:21:18.134799 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.134784 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 11:21:18.135469 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.135448 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 11:21:18.135581 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.135565 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.136055 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136036 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 11:21:18.136055 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136055 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 11:21:18.136219 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136205 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 18 11:21:18.136219 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136218 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 18 11:21:18.136333 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136320 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 11:21:18.136377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136337 2579 factory.go:55] Registering systemd factory Sep 18 11:21:18.136377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136350 2579 factory.go:223] Registration of the systemd container factory successfully Sep 18 11:21:18.136551 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136540 2579 factory.go:153] Registering CRI-O factory Sep 18 11:21:18.136551 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136552 2579 factory.go:223] Registration of the crio container factory successfully Sep 18 11:21:18.136663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136590 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 11:21:18.136663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136603 2579 factory.go:103] Registering Raw factory Sep 18 11:21:18.136663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136612 2579 manager.go:1196] Started watching for new ooms in manager Sep 18 11:21:18.136955 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.136943 2579 manager.go:349] Starting recovery of all containers Sep 18 11:21:18.138003 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.137953 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 11:21:18.138146 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.138122 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 11:21:18.138727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.138702 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c25zq" Sep 18 11:21:18.146890 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.146871 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c25zq" Sep 18 11:21:18.147340 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.147326 2579 manager.go:354] Recovery completed Sep 18 11:21:18.159870 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.159858 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.162371 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.162344 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.162469 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.162392 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.162469 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.162405 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.163181 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.163163 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 11:21:18.163181 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.163180 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 11:21:18.163307 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.163198 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 18 11:21:18.163807 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.163785 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.164774 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.164756 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.164846 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.164788 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.164846 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.164803 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.164846 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.164745 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-158.ec2.internal.18d66663328f05b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-158.ec2.internal,UID:ip-10-0-140-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-158.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-158.ec2.internal,},FirstTimestamp:2026-09-18 11:21:18.162380217 +0000 UTC m=+0.410284522,LastTimestamp:2026-09-18 11:21:18.162380217 +0000 UTC m=+0.410284522,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-158.ec2.internal,}" Sep 18 11:21:18.165203 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.165188 2579 policy_none.go:49] "None policy: Start" Sep 18 11:21:18.165264 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.165207 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 11:21:18.165264 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.165220 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 11:21:18.166399 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.166388 2579 policy_none.go:47] "Start" Sep 18 11:21:18.200564 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.200552 2579 manager.go:337] "Starting Device Plugin manager" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.200601 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.200612 2579 server.go:87] "Starting device plugin registration server" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.200869 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.200881 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.200960 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.201175 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.201185 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.201611 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 11:21:18.216711 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.201657 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.241332 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.241314 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 11:21:18.242630 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.242617 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 11:21:18.242693 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.242657 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 11:21:18.242693 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.242673 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 11:21:18.242762 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.242711 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 11:21:18.245155 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.245133 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:18.301243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.301227 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.302072 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.302034 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.302072 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.302061 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.302171 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.302077 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.302171 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.302099 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.310079 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.310066 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.310122 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.310085 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-158.ec2.internal\": node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.320129 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.320112 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.343722 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.343703 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal"] Sep 18 11:21:18.343778 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.343757 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.345138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.345124 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.345215 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.345152 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.345215 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.345167 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.346737 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.346723 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.346844 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.346819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.346844 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.346844 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.347402 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347373 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.347402 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347404 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.347547 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347382 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.347547 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347414 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.347547 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347434 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.347547 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.347451 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.348872 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.348859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.348941 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.348884 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 11:21:18.349527 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.349502 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientMemory" Sep 18 11:21:18.349586 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.349530 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 11:21:18.349586 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.349543 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeHasSufficientPID" Sep 18 11:21:18.377610 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.377592 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-158.ec2.internal\" not found" node="ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.382098 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.382084 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-158.ec2.internal\" not found" node="ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.420763 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.420745 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.437639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.437622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0095d41d65225b982774533d3effbe-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"fd0095d41d65225b982774533d3effbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.437703 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.437644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.437703 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.437661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.521322 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.521302 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.538623 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0095d41d65225b982774533d3effbe-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"fd0095d41d65225b982774533d3effbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.538673 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.538673 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.538747 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.538747 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538700 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd0095d41d65225b982774533d3effbe-config\") pod \"kube-apiserver-proxy-ip-10-0-140-158.ec2.internal\" (UID: \"fd0095d41d65225b982774533d3effbe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.538747 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.538715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cfff2193caa44b9ba380733eac9de16d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal\" (UID: \"cfff2193caa44b9ba380733eac9de16d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.622067 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.622010 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.681557 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.681537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.690876 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:18.690862 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:18.722700 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.722679 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.823154 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.823137 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:18.923735 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:18.923702 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:19.024278 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:19.024242 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:19.049241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.049217 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:19.075759 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.075734 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 11:21:19.076169 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.075893 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 11:21:19.076169 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.075906 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 11:21:19.125006 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:19.124963 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:19.157336 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.157296 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 11:16:18 +0000 UTC" deadline="2028-03-31 08:08:32.991592911 +0000 UTC" Sep 18 11:21:19.157336 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.157328 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13436h47m13.834267963s" Sep 18 11:21:19.225699 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:19.225619 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:19.325961 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:19.325935 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-158.ec2.internal\" not found" Sep 18 11:21:19.368787 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.368758 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:19.436655 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.436629 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" Sep 18 11:21:19.453109 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.453090 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 11:21:19.455019 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.455005 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" Sep 18 11:21:19.472886 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:19.472862 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfff2193caa44b9ba380733eac9de16d.slice/crio-402381c96a9884f568f0328c513ce0d98cf5b6054b8166baae536e93022a53d2 WatchSource:0}: Error finding container 402381c96a9884f568f0328c513ce0d98cf5b6054b8166baae536e93022a53d2: Status 404 returned error can't find the container with id 402381c96a9884f568f0328c513ce0d98cf5b6054b8166baae536e93022a53d2 Sep 18 11:21:19.473526 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:19.473511 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0095d41d65225b982774533d3effbe.slice/crio-9e3ba6dc2c41b6e1f52a9eb94c67b2290d5698b23c60354071706f34fc4ff29c WatchSource:0}: Error finding container 9e3ba6dc2c41b6e1f52a9eb94c67b2290d5698b23c60354071706f34fc4ff29c: Status 404 returned error can't find the container with id 9e3ba6dc2c41b6e1f52a9eb94c67b2290d5698b23c60354071706f34fc4ff29c Sep 18 11:21:19.478546 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.478533 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 11:21:19.480894 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.480873 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 11:21:19.529651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:19.529630 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:20.113075 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.113044 2579 apiserver.go:52] "Watching apiserver" Sep 18 11:21:20.120431 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.120413 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 11:21:20.122390 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.122366 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kpl85","kube-system/global-pull-secret-syncer-8xx7n","kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x","openshift-cluster-node-tuning-operator/tuned-h6x8t","openshift-dns/node-resolver-97cp9","openshift-image-registry/node-ca-zmbpw","openshift-multus/network-metrics-daemon-flfjv","openshift-network-diagnostics/network-check-target-ln924","kube-system/konnectivity-agent-4ppq4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal","openshift-multus/multus-additional-cni-plugins-s88tc","openshift-multus/multus-vdgzv","openshift-network-operator/iptables-alerter-2bhwq"] Sep 18 11:21:20.126431 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.126414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.128542 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.128515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.130599 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.130581 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jhkfw\"" Sep 18 11:21:20.130702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.130582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 11:21:20.130827 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.130812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.130971 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.130953 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.131852 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.131837 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.132147 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.132129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.132232 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.132218 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.132453 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.132435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2kds4\"" Sep 18 11:21:20.132522 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.132436 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 11:21:20.132970 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.132953 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 11:21:20.133118 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.133098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.135021 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.134993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.135133 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135064 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 11:21:20.135133 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135075 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g6ncm\"" Sep 18 11:21:20.135133 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.135460 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135437 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.135622 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135594 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 11:21:20.135752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.135752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8x5t6\"" Sep 18 11:21:20.135752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135726 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 11:21:20.135909 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.135826 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.137945 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.137927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.139107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.139088 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.139490 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.139474 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.139576 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.139502 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gg8w2\"" Sep 18 11:21:20.140399 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.140377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:20.140507 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.140458 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:20.141028 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.141012 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.141127 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.141107 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7x4ng\"" Sep 18 11:21:20.141181 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.141129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.143298 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.143280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.145642 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.145625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.145721 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.145697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:20.146921 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.146900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9jl\" (UniqueName: \"kubernetes.io/projected/a1122c9c-91d6-4464-ae73-de46097b39d4-kube-api-access-qg9jl\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.146931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-run\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.146957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-var-lib-kubelet\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.146980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x875t\" (UniqueName: \"kubernetes.io/projected/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kube-api-access-x875t\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-modprobe-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-kubernetes\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-lib-modules\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tssh4\" (UniqueName: \"kubernetes.io/projected/75bd82ac-7986-492e-8121-273671c9af75-kube-api-access-tssh4\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-multus\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-hostroot\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147257 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/009a33ce-da71-4d4d-9cd5-4a23d14c048c-iptables-alerter-script\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9zg\" (UniqueName: \"kubernetes.io/projected/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-kube-api-access-lt9zg\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-system-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-bin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-daemon-config\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-device-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-conf\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-etc-tuned\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147531 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-socket-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-systemd\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-sys\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-host\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-host\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-cnibin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009a33ce-da71-4d4d-9cd5-4a23d14c048c-host-slash\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysconfig\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-cni-binary-copy\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-netns\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147778 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-multus-certs\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-registration-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-sys-fs\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-tmp\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-hosts-file\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.147978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-serviceca\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.147966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-k8s-cni-cncf-io\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-etc-kubernetes\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x52kw\" (UniqueName: \"kubernetes.io/projected/009a33ce-da71-4d4d-9cd5-4a23d14c048c-kube-api-access-x52kw\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-tmp-dir\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk258\" (UniqueName: \"kubernetes.io/projected/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-kube-api-access-zk258\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.148684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148209 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vmvgx\"" Sep 18 11:21:20.148975 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.148229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-socket-dir-parent\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.150124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.149114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 11:21:20.150124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.149122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-kubelet\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.150124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.149183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-conf-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.150124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.149507 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 11:21:20.150404 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.150241 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 11:21:20.150690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.150563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 11:21:20.151181 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.151084 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z2ngb\"" Sep 18 11:21:20.151897 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.151454 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 11:21:20.151897 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.151520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.151897 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.151591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:20.152495 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.152475 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 11:21:20.154443 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.154421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.160434 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.160412 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 11:21:20.160509 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.160464 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 11:21:20.160641 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.160619 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 11:21:20.160757 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.160744 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7ct88\"" Sep 18 11:21:20.189266 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.189244 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpqjm" Sep 18 11:21:20.197372 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.197356 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpqjm" Sep 18 11:21:20.218420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.218403 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:20.237538 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.237522 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 11:21:20.248859 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.248818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" event={"ID":"fd0095d41d65225b982774533d3effbe","Type":"ContainerStarted","Data":"9e3ba6dc2c41b6e1f52a9eb94c67b2290d5698b23c60354071706f34fc4ff29c"} Sep 18 11:21:20.249383 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-socket-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.249493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.249493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.249493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-env-overrides\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.249493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-host\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-cnibin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-ovn\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-socket-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dddf419-57a1-4ad9-9412-80f60ef2d23b-agent-certs\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-cnibin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-cni-binary-copy\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-host\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-registration-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.249690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-sys-fs\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-tmp\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-var-lib-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249757 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-registration-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-dbus\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-k8s-cni-cncf-io\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-sys-fs\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-etc-kubernetes\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-k8s-cni-cncf-io\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-etc-kubernetes\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-tmp-dir\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-socket-dir-parent\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-kubelet\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.249998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-conf-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9jl\" (UniqueName: \"kubernetes.io/projected/a1122c9c-91d6-4464-ae73-de46097b39d4-kube-api-access-qg9jl\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-run\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.250274 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-socket-dir-parent\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250074 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-kubelet\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-conf-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-run\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-config\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-tmp-dir\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tssh4\" (UniqueName: \"kubernetes.io/projected/75bd82ac-7986-492e-8121-273671c9af75-kube-api-access-tssh4\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-systemd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-kubelet-config\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-cni-binary-copy\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-multus\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250412 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-hostroot\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250458 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-hostroot\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/009a33ce-da71-4d4d-9cd5-4a23d14c048c-iptables-alerter-script\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.251220 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-multus\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-netns\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-netd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-script-lib\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-bin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-daemon-config\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-device-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-var-lib-cni-bin\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-device-dir\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-kubelet\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-log-socket\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-bin\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.250985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"cfff2193caa44b9ba380733eac9de16d","Type":"ContainerStarted","Data":"402381c96a9884f568f0328c513ce0d98cf5b6054b8166baae536e93022a53d2"} Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/009a33ce-da71-4d4d-9cd5-4a23d14c048c-iptables-alerter-script\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.252107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-systemd\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-sys\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-host\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-systemd\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-systemd-units\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-sys\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-host\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009a33ce-da71-4d4d-9cd5-4a23d14c048c-host-slash\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1122c9c-91d6-4464-ae73-de46097b39d4-multus-daemon-config\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysconfig\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009a33ce-da71-4d4d-9cd5-4a23d14c048c-host-slash\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-etc-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysconfig\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-netns\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.252751 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-multus-certs\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-hosts-file\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-netns\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-hosts-file\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-node-log\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-host-run-multus-certs\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-serviceca\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x52kw\" (UniqueName: \"kubernetes.io/projected/009a33ce-da71-4d4d-9cd5-4a23d14c048c-kube-api-access-x52kw\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251676 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-slash\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cf58951-7c8f-427f-b755-58c00a687044-ovn-node-metrics-cert\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgx7\" (UniqueName: \"kubernetes.io/projected/8cf58951-7c8f-427f-b755-58c00a687044-kube-api-access-lzgx7\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-system-cni-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk258\" (UniqueName: \"kubernetes.io/projected/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-kube-api-access-zk258\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-var-lib-kubelet\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dddf419-57a1-4ad9-9412-80f60ef2d23b-konnectivity-ca\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x875t\" (UniqueName: \"kubernetes.io/projected/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kube-api-access-x875t\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.253386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-modprobe-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-kubernetes\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-lib-modules\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.251973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbcrd\" (UniqueName: \"kubernetes.io/projected/25a6b185-d5c0-4633-9cd3-c98282495bad-kube-api-access-mbcrd\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-serviceca\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9zg\" (UniqueName: \"kubernetes.io/projected/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-kube-api-access-lt9zg\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96szj\" (UniqueName: \"kubernetes.io/projected/2762780d-7603-4e20-b617-a34d482d5ed8-kube-api-access-96szj\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-system-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-conf\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-etc-tuned\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-cnibin\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-sysctl-conf\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1122c9c-91d6-4464-ae73-de46097b39d4-system-cni-dir\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-var-lib-kubelet\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbb871d8-bf02-482d-8fd7-6db8ca11e205-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.254142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-modprobe-d\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254990 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-etc-kubernetes\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254990 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.252799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bd82ac-7986-492e-8121-273671c9af75-lib-modules\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.254990 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.254707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-tmp\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.255734 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.255713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bd82ac-7986-492e-8121-273671c9af75-etc-tuned\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.265152 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.264596 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9jl\" (UniqueName: \"kubernetes.io/projected/a1122c9c-91d6-4464-ae73-de46097b39d4-kube-api-access-qg9jl\") pod \"multus-vdgzv\" (UID: \"a1122c9c-91d6-4464-ae73-de46097b39d4\") " pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.265152 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.265104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tssh4\" (UniqueName: \"kubernetes.io/projected/75bd82ac-7986-492e-8121-273671c9af75-kube-api-access-tssh4\") pod \"tuned-h6x8t\" (UID: \"75bd82ac-7986-492e-8121-273671c9af75\") " pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.265766 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.265742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x52kw\" (UniqueName: \"kubernetes.io/projected/009a33ce-da71-4d4d-9cd5-4a23d14c048c-kube-api-access-x52kw\") pod \"iptables-alerter-2bhwq\" (UID: \"009a33ce-da71-4d4d-9cd5-4a23d14c048c\") " pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.266745 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.266704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk258\" (UniqueName: \"kubernetes.io/projected/1f1d4fbb-ede0-48cf-9c28-d98695ed43da-kube-api-access-zk258\") pod \"node-ca-zmbpw\" (UID: \"1f1d4fbb-ede0-48cf-9c28-d98695ed43da\") " pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.267272 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.267251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9zg\" (UniqueName: \"kubernetes.io/projected/ee334868-22e2-4c03-80c9-7bfc3beb2aa9-kube-api-access-lt9zg\") pod \"node-resolver-97cp9\" (UID: \"ee334868-22e2-4c03-80c9-7bfc3beb2aa9\") " pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.268245 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.268224 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x875t\" (UniqueName: \"kubernetes.io/projected/dbb871d8-bf02-482d-8fd7-6db8ca11e205-kube-api-access-x875t\") pod \"aws-ebs-csi-driver-node-jkx4x\" (UID: \"dbb871d8-bf02-482d-8fd7-6db8ca11e205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.353172 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-config\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-systemd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-kubelet-config\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-netns\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353331 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-netd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-netd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-kubelet-config\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353390 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-netns\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-script-lib\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-systemd\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-kubelet\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-log-socket\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-bin\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-kubelet\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.353651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-log-socket\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-cni-bin\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-systemd-units\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-systemd-units\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-config\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-etc-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-etc-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354024 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.353912 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354053 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-node-log\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-node-log\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.354214 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-slash\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cf58951-7c8f-427f-b755-58c00a687044-ovn-node-metrics-cert\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgx7\" (UniqueName: \"kubernetes.io/projected/8cf58951-7c8f-427f-b755-58c00a687044-kube-api-access-lzgx7\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-system-cni-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-slash\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-ovnkube-script-lib\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dddf419-57a1-4ad9-9412-80f60ef2d23b-konnectivity-ca\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbcrd\" (UniqueName: \"kubernetes.io/projected/25a6b185-d5c0-4633-9cd3-c98282495bad-kube-api-access-mbcrd\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-binary-copy\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96szj\" (UniqueName: \"kubernetes.io/projected/2762780d-7603-4e20-b617-a34d482d5ed8-kube-api-access-96szj\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-cnibin\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a6b185-d5c0-4633-9cd3-c98282495bad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-env-overrides\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-ovn\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dddf419-57a1-4ad9-9412-80f60ef2d23b-agent-certs\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354554 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-system-cni-dir\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-var-lib-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-dbus\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-run-ovn\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-var-lib-openvswitch\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2dddf419-57a1-4ad9-9412-80f60ef2d23b-konnectivity-ca\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a6b185-d5c0-4633-9cd3-c98282495bad-cnibin\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cf58951-7c8f-427f-b755-58c00a687044-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.354857 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.354859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-dbus\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.354939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:20.854914359 +0000 UTC m=+3.102818649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.355033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cf58951-7c8f-427f-b755-58c00a687044-env-overrides\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.355101 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:20.355702 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.355162 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:20.855144534 +0000 UTC m=+3.103048827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:20.357552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.357273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cf58951-7c8f-427f-b755-58c00a687044-ovn-node-metrics-cert\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.357552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.357465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2dddf419-57a1-4ad9-9412-80f60ef2d23b-agent-certs\") pod \"konnectivity-agent-4ppq4\" (UID: \"2dddf419-57a1-4ad9-9412-80f60ef2d23b\") " pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.364800 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.364745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgx7\" (UniqueName: \"kubernetes.io/projected/8cf58951-7c8f-427f-b755-58c00a687044-kube-api-access-lzgx7\") pod \"ovnkube-node-kpl85\" (UID: \"8cf58951-7c8f-427f-b755-58c00a687044\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.365854 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.365832 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:20.365941 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.365859 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:20.365941 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.365872 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:20.365941 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.365922 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:20.865906472 +0000 UTC m=+3.113810785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:20.368853 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.368821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96szj\" (UniqueName: \"kubernetes.io/projected/2762780d-7603-4e20-b617-a34d482d5ed8-kube-api-access-96szj\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.368954 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.368905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbcrd\" (UniqueName: \"kubernetes.io/projected/25a6b185-d5c0-4633-9cd3-c98282495bad-kube-api-access-mbcrd\") pod \"multus-additional-cni-plugins-s88tc\" (UID: \"25a6b185-d5c0-4633-9cd3-c98282495bad\") " pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.437511 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.437475 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zmbpw" Sep 18 11:21:20.443278 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.443252 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdgzv" Sep 18 11:21:20.448977 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.448952 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1d4fbb_ede0_48cf_9c28_d98695ed43da.slice/crio-064dfb9d2d6ba5ec5711fb0a0b7f2fdf56321a126b6af4902d8e2c96977e292b WatchSource:0}: Error finding container 064dfb9d2d6ba5ec5711fb0a0b7f2fdf56321a126b6af4902d8e2c96977e292b: Status 404 returned error can't find the container with id 064dfb9d2d6ba5ec5711fb0a0b7f2fdf56321a126b6af4902d8e2c96977e292b Sep 18 11:21:20.453456 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.453433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2bhwq" Sep 18 11:21:20.454243 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.454221 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1122c9c_91d6_4464_ae73_de46097b39d4.slice/crio-bc0863c4b93853a1260dcdabd67a7feedad3d81cf86d0da0a6b99fedbe6ce516 WatchSource:0}: Error finding container bc0863c4b93853a1260dcdabd67a7feedad3d81cf86d0da0a6b99fedbe6ce516: Status 404 returned error can't find the container with id bc0863c4b93853a1260dcdabd67a7feedad3d81cf86d0da0a6b99fedbe6ce516 Sep 18 11:21:20.458728 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.458557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" Sep 18 11:21:20.465083 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.465060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" Sep 18 11:21:20.466021 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.465959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009a33ce_da71_4d4d_9cd5_4a23d14c048c.slice/crio-6bf5eb8c979280d2d441019d0e0cd67127595e1a1fc74fc5e586b603dc251cf3 WatchSource:0}: Error finding container 6bf5eb8c979280d2d441019d0e0cd67127595e1a1fc74fc5e586b603dc251cf3: Status 404 returned error can't find the container with id 6bf5eb8c979280d2d441019d0e0cd67127595e1a1fc74fc5e586b603dc251cf3 Sep 18 11:21:20.470477 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.470306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97cp9" Sep 18 11:21:20.470997 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.470971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb871d8_bf02_482d_8fd7_6db8ca11e205.slice/crio-855e8187ae1c3ea9e699969b0d4fe37903fa894266c9ac715d96c809a2c494d0 WatchSource:0}: Error finding container 855e8187ae1c3ea9e699969b0d4fe37903fa894266c9ac715d96c809a2c494d0: Status 404 returned error can't find the container with id 855e8187ae1c3ea9e699969b0d4fe37903fa894266c9ac715d96c809a2c494d0 Sep 18 11:21:20.476047 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.476029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:20.479196 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.479150 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bd82ac_7986_492e_8121_273671c9af75.slice/crio-9f537a70d9c0ac80754f4ff9def81a4469ca45a29ae85809d3d3411866861b27 WatchSource:0}: Error finding container 9f537a70d9c0ac80754f4ff9def81a4469ca45a29ae85809d3d3411866861b27: Status 404 returned error can't find the container with id 9f537a70d9c0ac80754f4ff9def81a4469ca45a29ae85809d3d3411866861b27 Sep 18 11:21:20.482276 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.482257 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:20.484502 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.484477 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee334868_22e2_4c03_80c9_7bfc3beb2aa9.slice/crio-b2903ef82506c7be7836477b4a6a02aa806d73f981b4a5f317439b6c8d0089a2 WatchSource:0}: Error finding container b2903ef82506c7be7836477b4a6a02aa806d73f981b4a5f317439b6c8d0089a2: Status 404 returned error can't find the container with id b2903ef82506c7be7836477b4a6a02aa806d73f981b4a5f317439b6c8d0089a2 Sep 18 11:21:20.485884 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.485638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s88tc" Sep 18 11:21:20.487885 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.486583 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf58951_7c8f_427f_b755_58c00a687044.slice/crio-d78bee8340c546b7a74453302b52956bfbeb0d4607c1bf2d92eb9f40b4d5906b WatchSource:0}: Error finding container d78bee8340c546b7a74453302b52956bfbeb0d4607c1bf2d92eb9f40b4d5906b: Status 404 returned error can't find the container with id d78bee8340c546b7a74453302b52956bfbeb0d4607c1bf2d92eb9f40b4d5906b Sep 18 11:21:20.499789 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.499700 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a6b185_d5c0_4633_9cd3_c98282495bad.slice/crio-198c67c289f60248a24cee658ecce707faf51b1f038b6f417af92e8afd529a5c WatchSource:0}: Error finding container 198c67c289f60248a24cee658ecce707faf51b1f038b6f417af92e8afd529a5c: Status 404 returned error can't find the container with id 198c67c289f60248a24cee658ecce707faf51b1f038b6f417af92e8afd529a5c Sep 18 11:21:20.500171 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:20.500087 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dddf419_57a1_4ad9_9412_80f60ef2d23b.slice/crio-6e683631791ba89ab5d7e012c9daf8837708f9066b36ec0909e6b0b74265d494 WatchSource:0}: Error finding container 6e683631791ba89ab5d7e012c9daf8837708f9066b36ec0909e6b0b74265d494: Status 404 returned error can't find the container with id 6e683631791ba89ab5d7e012c9daf8837708f9066b36ec0909e6b0b74265d494 Sep 18 11:21:20.858848 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.858811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:20.859061 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.858891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:20.859155 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.859076 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:20.859155 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.859136 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:21.859117123 +0000 UTC m=+4.107021425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:20.859490 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.859465 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:20.859607 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.859521 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:21.859506475 +0000 UTC m=+4.107410763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:20.959379 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:20.959344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:20.959571 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.959528 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:20.959571 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.959548 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:20.959571 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.959559 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:20.959734 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:20.959615 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:21.959596383 +0000 UTC m=+4.207500697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:21.201059 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.201009 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 11:16:20 +0000 UTC" deadline="2028-03-01 07:52:18.648013988 +0000 UTC" Sep 18 11:21:21.201726 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.201080 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12716h30m57.446965939s" Sep 18 11:21:21.255915 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.255787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdgzv" event={"ID":"a1122c9c-91d6-4464-ae73-de46097b39d4","Type":"ContainerStarted","Data":"bc0863c4b93853a1260dcdabd67a7feedad3d81cf86d0da0a6b99fedbe6ce516"} Sep 18 11:21:21.257455 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.257422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmbpw" event={"ID":"1f1d4fbb-ede0-48cf-9c28-d98695ed43da","Type":"ContainerStarted","Data":"064dfb9d2d6ba5ec5711fb0a0b7f2fdf56321a126b6af4902d8e2c96977e292b"} Sep 18 11:21:21.263067 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.263039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerStarted","Data":"198c67c289f60248a24cee658ecce707faf51b1f038b6f417af92e8afd529a5c"} Sep 18 11:21:21.264663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.264628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ppq4" event={"ID":"2dddf419-57a1-4ad9-9412-80f60ef2d23b","Type":"ContainerStarted","Data":"6e683631791ba89ab5d7e012c9daf8837708f9066b36ec0909e6b0b74265d494"} Sep 18 11:21:21.266538 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.266513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"d78bee8340c546b7a74453302b52956bfbeb0d4607c1bf2d92eb9f40b4d5906b"} Sep 18 11:21:21.268894 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.268873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97cp9" event={"ID":"ee334868-22e2-4c03-80c9-7bfc3beb2aa9","Type":"ContainerStarted","Data":"b2903ef82506c7be7836477b4a6a02aa806d73f981b4a5f317439b6c8d0089a2"} Sep 18 11:21:21.270412 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.270390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" event={"ID":"75bd82ac-7986-492e-8121-273671c9af75","Type":"ContainerStarted","Data":"9f537a70d9c0ac80754f4ff9def81a4469ca45a29ae85809d3d3411866861b27"} Sep 18 11:21:21.272334 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.272313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2bhwq" event={"ID":"009a33ce-da71-4d4d-9cd5-4a23d14c048c","Type":"ContainerStarted","Data":"6bf5eb8c979280d2d441019d0e0cd67127595e1a1fc74fc5e586b603dc251cf3"} Sep 18 11:21:21.273898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.273872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" event={"ID":"dbb871d8-bf02-482d-8fd7-6db8ca11e205","Type":"ContainerStarted","Data":"855e8187ae1c3ea9e699969b0d4fe37903fa894266c9ac715d96c809a2c494d0"} Sep 18 11:21:21.867778 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.867727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:21.867982 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.867826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:21.867982 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.867968 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:21.868118 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.868057 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:23.86801379 +0000 UTC m=+6.115918092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:21.868454 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.868432 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:21.868556 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.868489 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:23.868478086 +0000 UTC m=+6.116382373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:21.969039 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:21.968989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:21.969242 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.969154 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:21.969242 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.969173 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:21.969242 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.969182 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:21.969242 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:21.969228 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:23.9692152 +0000 UTC m=+6.217119487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:22.131505 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.131473 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 11:21:22.202291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.202228 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 11:16:20 +0000 UTC" deadline="2028-05-29 21:02:52.988165298 +0000 UTC" Sep 18 11:21:22.202291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.202287 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14865h41m30.785881844s" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.246585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:22.246728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.247173 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:22.247265 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:22.247335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:22.247462 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:22.247415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:23.885935 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:23.885551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:23.885935 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:23.885622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:23.885935 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.885758 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:23.885935 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.885807 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:27.885793474 +0000 UTC m=+10.133697760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:23.885935 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.885948 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:23.886722 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.885975 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:27.88596651 +0000 UTC m=+10.133870796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:23.986439 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:23.986399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:23.986639 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.986599 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:23.986639 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.986623 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:23.986639 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.986638 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:23.986806 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:23.986687 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:27.986672305 +0000 UTC m=+10.234576591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:24.245888 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:24.245850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:24.246080 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:24.246003 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:24.246418 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:24.246383 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:24.246516 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:24.246497 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:24.246594 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:24.246527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:24.246661 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:24.246600 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:26.244865 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:26.244087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:26.244865 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:26.244358 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:26.244865 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:26.244730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:26.244865 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:26.244819 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:26.245630 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:26.245602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:26.245756 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:26.245706 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:27.921108 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:27.921070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:27.921561 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:27.921153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:27.921561 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:27.921278 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:27.921561 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:27.921343 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:35.921324358 +0000 UTC m=+18.169228668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:27.921783 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:27.921736 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:27.921846 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:27.921791 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:35.921775873 +0000 UTC m=+18.169680174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:28.022374 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:28.021747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:28.022374 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.021914 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:28.022374 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.021944 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:28.022374 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.021957 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:28.022374 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.022033 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:36.022014596 +0000 UTC m=+18.269918886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:28.244189 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:28.244107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:28.244336 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.244236 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:28.245685 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:28.245661 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:28.245804 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.245761 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:28.247778 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:28.247638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:28.247778 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:28.247736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:30.243627 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:30.243562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:30.243627 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:30.243587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:30.243627 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:30.243613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:30.244273 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:30.243704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:30.244273 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:30.243790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:30.244273 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:30.243918 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:32.243829 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:32.243797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:32.243829 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:32.243812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:32.244265 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:32.243808 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:32.244265 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:32.243928 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:32.244265 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:32.244032 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:32.244265 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:32.244115 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:34.243780 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:34.243740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:34.244253 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:34.243751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:34.244253 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:34.243878 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:34.244253 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:34.243908 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:34.244253 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:34.244012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:34.244253 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:34.244096 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:35.974608 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:35.974568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:35.975100 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:35.974645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:35.975100 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:35.974710 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:35.975100 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:35.974751 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:35.975100 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:35.974791 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:51.974771305 +0000 UTC m=+34.222675596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:35.975100 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:35.974809 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:21:51.974802675 +0000 UTC m=+34.222706959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:36.075645 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:36.075605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:36.075826 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.075765 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:36.075826 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.075792 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:36.075826 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.075804 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:36.075981 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.075868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:52.075850148 +0000 UTC m=+34.323754449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:36.246435 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:36.246358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:36.246435 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:36.246377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:36.246647 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.246476 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:36.246647 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.246537 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:36.246647 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:36.246569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:36.246785 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:36.246650 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:38.244601 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:38.244567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:38.245058 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:38.244704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:38.245058 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:38.244766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:38.245058 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:38.244848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:38.245058 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:38.244873 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:38.245058 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:38.244911 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:39.315651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.314943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" event={"ID":"75bd82ac-7986-492e-8121-273671c9af75","Type":"ContainerStarted","Data":"a0c8687e19cda54e42da2f1de881bc4e82d91691324db74d4ed57a0c32811268"} Sep 18 11:21:39.317148 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.317119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" event={"ID":"fd0095d41d65225b982774533d3effbe","Type":"ContainerStarted","Data":"5079a9bf5aeb9239c15b4ac463d32c833a374992a81bc324ffb518f3e068793a"} Sep 18 11:21:39.318676 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.318601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdgzv" event={"ID":"a1122c9c-91d6-4464-ae73-de46097b39d4","Type":"ContainerStarted","Data":"eb5031551002e7278367e391558644e41617d6313e95d38a93a0fbdbf5326762"} Sep 18 11:21:39.323659 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.323619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:21:39.324123 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324098 2579 generic.go:356] "Generic (PLEG): container finished" podID="8cf58951-7c8f-427f-b755-58c00a687044" containerID="e4b2f20c090e03f3330bee31e6d42da35700bf95b4b974fd7edaa85426d4f452" exitCode=1 Sep 18 11:21:39.324123 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"98580ba0f21ba1bb4b6481ae4b80c3a7f38ad9497ad2d87980d22b6fa7c844bc"} Sep 18 11:21:39.324275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"de53fc313f9813c0b0d1cd0a13cfae23eee32aa38461e1758fad7c575517c324"} Sep 18 11:21:39.324275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"cfc6e709fe19e26f2ee0239b3027705d2867d674dceb4011754ddcc90619529b"} Sep 18 11:21:39.324275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324256 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"61f1f37740a9ccd0b9f1932c3c251d06534bd9d14a4abb1dc7e70980a247d815"} Sep 18 11:21:39.324420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerDied","Data":"e4b2f20c090e03f3330bee31e6d42da35700bf95b4b974fd7edaa85426d4f452"} Sep 18 11:21:39.324420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.324349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"5c5629bede7b45f2379f59006d48ee780ac06eaeb7d353737c795fe29d690cb0"} Sep 18 11:21:39.334935 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.334897 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6x8t" podStartSLOduration=3.2919685530000002 podStartE2EDuration="21.334884034s" totalImagesPullingTime="18.042915481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:39.33485156 +0000 UTC m=+21.582755866" watchObservedRunningTime="2026-09-18 11:21:39.334884034 +0000 UTC m=+21.582788339" Sep 18 11:21:39.349928 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.349891 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-158.ec2.internal" podStartSLOduration=20.349876481 podStartE2EDuration="20.349876481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:39.349824497 +0000 UTC m=+21.597728804" watchObservedRunningTime="2026-09-18 11:21:39.349876481 +0000 UTC m=+21.597780787" Sep 18 11:21:39.370624 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:39.370588 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vdgzv" podStartSLOduration=3.261627189 podStartE2EDuration="21.370575402s" totalImagesPullingTime="18.108948213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:39.370272266 +0000 UTC m=+21.618176572" watchObservedRunningTime="2026-09-18 11:21:39.370575402 +0000 UTC m=+21.618479708" Sep 18 11:21:40.243584 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.243557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:40.243735 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.243560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:40.243735 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:40.243653 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:40.243735 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.243570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:40.243842 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:40.243788 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:40.243842 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:40.243717 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:40.327591 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.327549 2579 generic.go:356] "Generic (PLEG): container finished" podID="cfff2193caa44b9ba380733eac9de16d" containerID="7ccb439487b009cf99f515e0ba6ba867451ef287ac0206e87e591b1413ad0dec" exitCode=0 Sep 18 11:21:40.328328 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.327636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"cfff2193caa44b9ba380733eac9de16d","Type":"ContainerDied","Data":"7ccb439487b009cf99f515e0ba6ba867451ef287ac0206e87e591b1413ad0dec"} Sep 18 11:21:40.330402 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.330372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" event={"ID":"dbb871d8-bf02-482d-8fd7-6db8ca11e205","Type":"ContainerStarted","Data":"8d0606eaa9d405cdc575c8ce4b81529edf5f64ae3376b6cd8534d0bb3e286370"} Sep 18 11:21:40.331855 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.331814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zmbpw" event={"ID":"1f1d4fbb-ede0-48cf-9c28-d98695ed43da","Type":"ContainerStarted","Data":"1eeb5139065b9ba210d5176e1a3096bb7f1166ef4ab8217ff6abd72191288b99"} Sep 18 11:21:40.333241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.333219 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="1da0ad2464b63fafde6539c859cd60146a65708294af3f76dd1af0052a927f19" exitCode=0 Sep 18 11:21:40.333333 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.333252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"1da0ad2464b63fafde6539c859cd60146a65708294af3f76dd1af0052a927f19"} Sep 18 11:21:40.334890 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.334873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ppq4" event={"ID":"2dddf419-57a1-4ad9-9412-80f60ef2d23b","Type":"ContainerStarted","Data":"0a08f6acc571e29fe5095f337cdf217ff305410390a07d6835c7ce5889af5c6c"} Sep 18 11:21:40.336377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.336348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97cp9" event={"ID":"ee334868-22e2-4c03-80c9-7bfc3beb2aa9","Type":"ContainerStarted","Data":"d9fa2def914c7856d10400873e5215b8b6005b7b67ed5b538e132d1b72e48a44"} Sep 18 11:21:40.337660 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.337642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2bhwq" event={"ID":"009a33ce-da71-4d4d-9cd5-4a23d14c048c","Type":"ContainerStarted","Data":"8d3ac55692d2cdc1d21d32fd3fc322207b73107e4d9b8bb2bed7444ecd3d8252"} Sep 18 11:21:40.393886 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.393849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zmbpw" podStartSLOduration=15.793268348 podStartE2EDuration="22.393836343s" totalImagesPullingTime="6.600567995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:40.367788336 +0000 UTC m=+22.615692644" watchObservedRunningTime="2026-09-18 11:21:40.393836343 +0000 UTC m=+22.641740650" Sep 18 11:21:40.409258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.409223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4ppq4" podStartSLOduration=4.386321416 podStartE2EDuration="22.409209022s" totalImagesPullingTime="18.022887606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:40.409134743 +0000 UTC m=+22.657039049" watchObservedRunningTime="2026-09-18 11:21:40.409209022 +0000 UTC m=+22.657113328" Sep 18 11:21:40.426127 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.425978 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-97cp9" podStartSLOduration=4.5773145710000005 podStartE2EDuration="22.425965885s" totalImagesPullingTime="17.848651314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:40.425609951 +0000 UTC m=+22.673514257" watchObservedRunningTime="2026-09-18 11:21:40.425965885 +0000 UTC m=+22.673870190" Sep 18 11:21:40.441186 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:40.441158 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2bhwq" podStartSLOduration=4.573836713 podStartE2EDuration="22.441146139s" totalImagesPullingTime="17.867309426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:40.441045347 +0000 UTC m=+22.688949652" watchObservedRunningTime="2026-09-18 11:21:40.441146139 +0000 UTC m=+22.689050444" Sep 18 11:21:41.196590 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.196567 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 11:21:41.211398 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.211304 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T11:21:41.196587266Z","UUID":"0071796b-7dc8-4658-a908-d84c1bf10443","Handler":null,"Name":"","Endpoint":""} Sep 18 11:21:41.212709 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.212678 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 11:21:41.212709 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.212709 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 11:21:41.262272 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.262241 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:41.263388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.263359 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:41.343134 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.342658 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" event={"ID":"cfff2193caa44b9ba380733eac9de16d","Type":"ContainerStarted","Data":"b1351e25a82bb5ab8e01c8d05737432d30922fe796e721b340e9af4566bbef77"} Sep 18 11:21:41.344876 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.344848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" event={"ID":"dbb871d8-bf02-482d-8fd7-6db8ca11e205","Type":"ContainerStarted","Data":"6bcbc31aadd0a0e4770415528cf67b917b6a0f5f69ea85b51ff06a9027be69d6"} Sep 18 11:21:41.345718 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.345262 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:41.345817 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.345739 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4ppq4" Sep 18 11:21:41.358705 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:41.358666 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-158.ec2.internal" podStartSLOduration=22.358652263 podStartE2EDuration="22.358652263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:41.358233244 +0000 UTC m=+23.606137566" watchObservedRunningTime="2026-09-18 11:21:41.358652263 +0000 UTC m=+23.606556588" Sep 18 11:21:42.246048 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.246025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:42.246206 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.246025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:42.246206 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:42.246123 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:42.246206 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.246025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:42.246206 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:42.246186 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:42.246380 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:42.246273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:42.348666 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.348633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" event={"ID":"dbb871d8-bf02-482d-8fd7-6db8ca11e205","Type":"ContainerStarted","Data":"167e8c432c56d1d8a98ec560cb099ca96cfd6c0b327e2a76fb978f44e2b058b0"} Sep 18 11:21:42.351681 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.351662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:21:42.352035 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:42.352016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"d4c6d6e01b7ee6360add4ec41cc3592cefbd9543750c43018bf83b8c23dbb9ca"} Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:44.243020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:44.243142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:44.243157 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:44.243256 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:44.243308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:44.243532 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:44.243394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:45.361464 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.361291 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="5a776edb08701c95275a225a4f26fc710c8c466797668eb3da125ef269f5e454" exitCode=0 Sep 18 11:21:45.362192 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.361386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"5a776edb08701c95275a225a4f26fc710c8c466797668eb3da125ef269f5e454"} Sep 18 11:21:45.365177 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.365156 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:21:45.365499 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.365479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"49247c2321fea0391d439cb8a095f0e02401e2adb28199162728b12feb279c22"} Sep 18 11:21:45.365768 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.365748 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:45.365880 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.365866 2579 scope.go:117] "RemoveContainer" containerID="e4b2f20c090e03f3330bee31e6d42da35700bf95b4b974fd7edaa85426d4f452" Sep 18 11:21:45.382385 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.382364 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:45.391929 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:45.391894 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkx4x" podStartSLOduration=7.289308175 podStartE2EDuration="27.391882439s" totalImagesPullingTime="20.102574264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:42.368596785 +0000 UTC m=+24.616501091" watchObservedRunningTime="2026-09-18 11:21:45.391882439 +0000 UTC m=+27.639786745" Sep 18 11:21:46.243209 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.243000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:46.243328 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.243114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:46.243387 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.243135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:46.243387 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.243365 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:46.243387 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.243368 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:46.243530 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.243441 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:46.297423 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.297397 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8xx7n"] Sep 18 11:21:46.298011 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.297968 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ln924"] Sep 18 11:21:46.301253 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.300371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flfjv"] Sep 18 11:21:46.370265 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.370180 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="525bf0d53b28c1046418a1ec70625c2a5d8f7a6b41d099ec2a2fc961d8e0378b" exitCode=0 Sep 18 11:21:46.370806 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.370265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"525bf0d53b28c1046418a1ec70625c2a5d8f7a6b41d099ec2a2fc961d8e0378b"} Sep 18 11:21:46.374312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:21:46.374730 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:46.374804 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" event={"ID":"8cf58951-7c8f-427f-b755-58c00a687044","Type":"ContainerStarted","Data":"de1fa309697a9574ae12ce36993242b7169e222c66336c16b605afa4773d0202"} Sep 18 11:21:46.374804 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374770 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 11:21:46.374893 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.374811 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:46.374893 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:46.374893 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:46.374893 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.374855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:46.375049 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.374968 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:46.375096 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:46.375046 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:46.390847 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.390828 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:46.419940 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.419899 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" podStartSLOduration=10.326373505 podStartE2EDuration="28.419884591s" totalImagesPullingTime="18.093511086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:46.419547198 +0000 UTC m=+28.667451542" watchObservedRunningTime="2026-09-18 11:21:46.419884591 +0000 UTC m=+28.667788897" Sep 18 11:21:46.983367 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:46.983334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:47.127874 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.127844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:47.379880 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.379852 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="ee9f610840fc985250842ee69514c09ad1d8eefc09ae7895e66eab721881e8e5" exitCode=0 Sep 18 11:21:47.380245 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.379953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"ee9f610840fc985250842ee69514c09ad1d8eefc09ae7895e66eab721881e8e5"} Sep 18 11:21:47.380245 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.380007 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 11:21:47.754374 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.754351 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:47.900977 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:47.900946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:48.012353 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.012239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:48.243790 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.243759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:48.244080 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.243816 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:48.244182 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:48.244133 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:48.244182 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.243843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:48.244292 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:48.244190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:48.244292 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:48.244275 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:48.410764 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.410724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:48.881277 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:48.881244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:49.398999 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:49.398954 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpl85" Sep 18 11:21:49.576893 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:49.576832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:49.662075 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:49.661973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:49.761558 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:49.761519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:50.243039 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:50.243007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:50.243226 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:50.243006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:50.243226 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:50.243125 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xx7n" podUID="f1ea3303-23f9-4d8c-8df7-34704cb6afbb" Sep 18 11:21:50.243226 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:50.243199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ln924" podUID="c10be526-101c-4a5a-86a2-82ab9f443bb5" Sep 18 11:21:50.243226 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:50.243007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:50.243405 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:50.243297 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-flfjv" podUID="2762780d-7603-4e20-b617-a34d482d5ed8" Sep 18 11:21:51.561452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.561281 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-158.ec2.internal" event="NodeReady" Sep 18 11:21:51.561741 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.561557 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 11:21:51.623857 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.623829 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2626p"] Sep 18 11:21:51.625792 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.625778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.628453 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.628433 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k6rq5"] Sep 18 11:21:51.629201 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.629179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 11:21:51.629297 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.629203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 11:21:51.629297 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.629217 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqz2n\"" Sep 18 11:21:51.630213 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.630197 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.632714 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.632678 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 11:21:51.632861 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.632842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 11:21:51.632962 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.632878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 11:21:51.632962 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.632904 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5zfdm\"" Sep 18 11:21:51.646260 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.646238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2626p"] Sep 18 11:21:51.646588 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.646572 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6rq5"] Sep 18 11:21:51.782147 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdvj\" (UniqueName: \"kubernetes.io/projected/ca6eebff-698f-40e8-94fc-effc82859ada-kube-api-access-bgdvj\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.782147 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-cert\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.782383 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca6eebff-698f-40e8-94fc-effc82859ada-tmp-dir\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.782383 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6eebff-698f-40e8-94fc-effc82859ada-config-volume\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.782383 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.782383 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.782266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wldlc\" (UniqueName: \"kubernetes.io/projected/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-kube-api-access-wldlc\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.839882 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.839847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:51.882849 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdvj\" (UniqueName: \"kubernetes.io/projected/ca6eebff-698f-40e8-94fc-effc82859ada-kube-api-access-bgdvj\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.882849 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-cert\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.883113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca6eebff-698f-40e8-94fc-effc82859ada-tmp-dir\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.883113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6eebff-698f-40e8-94fc-effc82859ada-config-volume\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.883113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.883113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.882974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wldlc\" (UniqueName: \"kubernetes.io/projected/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-kube-api-access-wldlc\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.883113 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.883073 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 11:21:51.883364 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.883149 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls podName:ca6eebff-698f-40e8-94fc-effc82859ada nodeName:}" failed. No retries permitted until 2026-09-18 11:21:52.383126582 +0000 UTC m=+34.631030889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls") pod "dns-default-2626p" (UID: "ca6eebff-698f-40e8-94fc-effc82859ada") : secret "dns-default-metrics-tls" not found Sep 18 11:21:51.883364 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.883245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca6eebff-698f-40e8-94fc-effc82859ada-tmp-dir\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.883552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.883531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ca6eebff-698f-40e8-94fc-effc82859ada-config-volume\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.887049 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.887035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-cert\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.892159 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.892140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wldlc\" (UniqueName: \"kubernetes.io/projected/c6bc485a-1a7e-47d4-89a3-32cc283b0b6e-kube-api-access-wldlc\") pod \"ingress-canary-k6rq5\" (UID: \"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e\") " pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.892844 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.892814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdvj\" (UniqueName: \"kubernetes.io/projected/ca6eebff-698f-40e8-94fc-effc82859ada-kube-api-access-bgdvj\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:51.940067 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.940038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k6rq5" Sep 18 11:21:51.953584 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.953555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:51.984018 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.983968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:51.984153 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:51.984063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:51.984153 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.984099 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:51.984221 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.984159 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:51.984221 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.984165 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret podName:f1ea3303-23f9-4d8c-8df7-34704cb6afbb nodeName:}" failed. No retries permitted until 2026-09-18 11:22:23.984148617 +0000 UTC m=+66.232052901 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret") pod "global-pull-secret-syncer-8xx7n" (UID: "f1ea3303-23f9-4d8c-8df7-34704cb6afbb") : object "kube-system"/"original-pull-secret" not registered Sep 18 11:21:51.984221 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:51.984217 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs podName:2762780d-7603-4e20-b617-a34d482d5ed8 nodeName:}" failed. No retries permitted until 2026-09-18 11:22:23.984203386 +0000 UTC m=+66.232107671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs") pod "network-metrics-daemon-flfjv" (UID: "2762780d-7603-4e20-b617-a34d482d5ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 11:21:52.084656 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.084628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:52.084778 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.084753 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 11:21:52.084778 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.084767 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 11:21:52.084778 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.084775 2579 projected.go:196] Error preparing data for projected volume kube-api-access-zmbtt for pod openshift-network-diagnostics/network-check-target-ln924: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:52.084879 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.084819 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt podName:c10be526-101c-4a5a-86a2-82ab9f443bb5 nodeName:}" failed. No retries permitted until 2026-09-18 11:22:24.084806784 +0000 UTC m=+66.332711068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zmbtt" (UniqueName: "kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt") pod "network-check-target-ln924" (UID: "c10be526-101c-4a5a-86a2-82ab9f443bb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 11:21:52.219693 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.219630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k6rq5"] Sep 18 11:21:52.222550 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:52.222520 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bc485a_1a7e_47d4_89a3_32cc283b0b6e.slice/crio-9e8a95283d8ae99d8504cb6e96141e83a56358047d7351e02e17ccecc7c5b23f WatchSource:0}: Error finding container 9e8a95283d8ae99d8504cb6e96141e83a56358047d7351e02e17ccecc7c5b23f: Status 404 returned error can't find the container with id 9e8a95283d8ae99d8504cb6e96141e83a56358047d7351e02e17ccecc7c5b23f Sep 18 11:21:52.243201 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.243175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:21:52.243201 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.243191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:21:52.243452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.243429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:21:52.245953 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.245937 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwrtn\"" Sep 18 11:21:52.246069 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.246017 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 11:21:52.246125 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.246093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmzwd\"" Sep 18 11:21:52.246210 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.246195 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 11:21:52.246271 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.246216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 11:21:52.246271 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.246224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 11:21:52.385975 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.385952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:52.386128 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.386075 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 11:21:52.386128 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:52.386124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls podName:ca6eebff-698f-40e8-94fc-effc82859ada nodeName:}" failed. No retries permitted until 2026-09-18 11:21:53.386111839 +0000 UTC m=+35.634016127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls") pod "dns-default-2626p" (UID: "ca6eebff-698f-40e8-94fc-effc82859ada") : secret "dns-default-metrics-tls" not found Sep 18 11:21:52.398291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.398271 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="c94ebaf2906443ee8a15cfad5954a6f4daa31f43fffa8ebea57476e4bf631432" exitCode=0 Sep 18 11:21:52.398419 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.398343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"c94ebaf2906443ee8a15cfad5954a6f4daa31f43fffa8ebea57476e4bf631432"} Sep 18 11:21:52.399569 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:52.399552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6rq5" event={"ID":"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e","Type":"ContainerStarted","Data":"9e8a95283d8ae99d8504cb6e96141e83a56358047d7351e02e17ccecc7c5b23f"} Sep 18 11:21:53.394201 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:53.394169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:53.394949 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:53.394338 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 11:21:53.394949 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:53.394411 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls podName:ca6eebff-698f-40e8-94fc-effc82859ada nodeName:}" failed. No retries permitted until 2026-09-18 11:21:55.39439207 +0000 UTC m=+37.642296354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls") pod "dns-default-2626p" (UID: "ca6eebff-698f-40e8-94fc-effc82859ada") : secret "dns-default-metrics-tls" not found Sep 18 11:21:53.406007 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:53.405965 2579 generic.go:356] "Generic (PLEG): container finished" podID="25a6b185-d5c0-4633-9cd3-c98282495bad" containerID="057fbcc6e036463bb81409c4a66d11324f47df3b616e74d2bc2331a569181623" exitCode=0 Sep 18 11:21:53.406140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:53.406026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerDied","Data":"057fbcc6e036463bb81409c4a66d11324f47df3b616e74d2bc2331a569181623"} Sep 18 11:21:53.496080 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:53.495882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:53.581640 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:53.581600 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.252207 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.252183 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q"] Sep 18 11:21:54.254290 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.254260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.266140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.266124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" Sep 18 11:21:54.268618 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.268600 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 11:21:54.268849 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.268831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fw9nl\"" Sep 18 11:21:54.269883 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.269871 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 11:21:54.276318 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.276299 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q"] Sep 18 11:21:54.335161 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.335135 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.401643 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.401614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvknd\" (UniqueName: \"kubernetes.io/projected/a67a86e9-772d-4292-9c1e-6bbeccd71845-kube-api-access-hvknd\") pod \"migrator-76794cbd6c-j7j4q\" (UID: \"a67a86e9-772d-4292-9c1e-6bbeccd71845\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" Sep 18 11:21:54.411634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.411610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s88tc" event={"ID":"25a6b185-d5c0-4633-9cd3-c98282495bad","Type":"ContainerStarted","Data":"e358a96f4137e1f5abdf63b2f4c6ac1dd640c58c1420fed1ccd6ce1d0a4f5b3e"} Sep 18 11:21:54.437019 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.436950 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s88tc" podStartSLOduration=9.048955534 podStartE2EDuration="36.436932687s" totalImagesPullingTime="27.387977153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:54.435524469 +0000 UTC m=+36.683428775" watchObservedRunningTime="2026-09-18 11:21:54.436932687 +0000 UTC m=+36.684836992" Sep 18 11:21:54.437612 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.437585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.502849 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.502773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvknd\" (UniqueName: \"kubernetes.io/projected/a67a86e9-772d-4292-9c1e-6bbeccd71845-kube-api-access-hvknd\") pod \"migrator-76794cbd6c-j7j4q\" (UID: \"a67a86e9-772d-4292-9c1e-6bbeccd71845\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" Sep 18 11:21:54.512261 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.512235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvknd\" (UniqueName: \"kubernetes.io/projected/a67a86e9-772d-4292-9c1e-6bbeccd71845-kube-api-access-hvknd\") pod \"migrator-76794cbd6c-j7j4q\" (UID: \"a67a86e9-772d-4292-9c1e-6bbeccd71845\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" Sep 18 11:21:54.574173 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.574141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" Sep 18 11:21:54.681518 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.681494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.712537 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.712510 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xqj6m"] Sep 18 11:21:54.729925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.729904 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.733225 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.733203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 11:21:54.733364 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.733280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 11:21:54.733364 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.733304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 11:21:54.733547 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.733530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2mbt\"" Sep 18 11:21:54.733631 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.733594 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 11:21:54.736818 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.736412 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqj6m"] Sep 18 11:21:54.792080 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.791960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:54.805132 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.805083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.805291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.805158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38866fee-916c-4397-b667-ce7156c469c1-crio-socket\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.805291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.805183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38866fee-916c-4397-b667-ce7156c469c1-data-volume\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.805291 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.805268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.805388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.805336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stspd\" (UniqueName: \"kubernetes.io/projected/38866fee-916c-4397-b667-ce7156c469c1-kube-api-access-stspd\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.859591 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.859557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q"] Sep 18 11:21:54.864673 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:54.864648 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67a86e9_772d_4292_9c1e_6bbeccd71845.slice/crio-93b9caf8a83b853a2906c1bcadad848c51f59f8ce5c906da4657bc28a644cf2d WatchSource:0}: Error finding container 93b9caf8a83b853a2906c1bcadad848c51f59f8ce5c906da4657bc28a644cf2d: Status 404 returned error can't find the container with id 93b9caf8a83b853a2906c1bcadad848c51f59f8ce5c906da4657bc28a644cf2d Sep 18 11:21:54.906563 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stspd\" (UniqueName: \"kubernetes.io/projected/38866fee-916c-4397-b667-ce7156c469c1-kube-api-access-stspd\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.906692 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.906692 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38866fee-916c-4397-b667-ce7156c469c1-crio-socket\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.906692 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38866fee-916c-4397-b667-ce7156c469c1-data-volume\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.906692 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.907023 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:54.906745 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 11:21:54.907023 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:54.906749 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 11:21:54.907023 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:54.906813 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:55.406795977 +0000 UTC m=+37.654700262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : secret "insights-runtime-extractor-tls" not found Sep 18 11:21:54.907023 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:54.906837 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:55.406830149 +0000 UTC m=+37.654734438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : configmap "kube-rbac-proxy" not found Sep 18 11:21:54.907023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.906843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38866fee-916c-4397-b667-ce7156c469c1-crio-socket\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.907213 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.907054 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38866fee-916c-4397-b667-ce7156c469c1-data-volume\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.918437 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.918401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stspd\" (UniqueName: \"kubernetes.io/projected/38866fee-916c-4397-b667-ce7156c469c1-kube-api-access-stspd\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:54.995157 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:54.994936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:55.085738 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.085663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:55.411773 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.411737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.411795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.411812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.411858 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.411870 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.411924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:56.411907774 +0000 UTC m=+38.659812058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : configmap "kube-rbac-proxy" not found Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.411941 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:56.411932227 +0000 UTC m=+38.659836515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : secret "insights-runtime-extractor-tls" not found Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.411979 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 11:21:55.412271 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:55.412076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls podName:ca6eebff-698f-40e8-94fc-effc82859ada nodeName:}" failed. No retries permitted until 2026-09-18 11:21:59.412053023 +0000 UTC m=+41.659957321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls") pod "dns-default-2626p" (UID: "ca6eebff-698f-40e8-94fc-effc82859ada") : secret "dns-default-metrics-tls" not found Sep 18 11:21:55.415366 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.415337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k6rq5" event={"ID":"c6bc485a-1a7e-47d4-89a3-32cc283b0b6e","Type":"ContainerStarted","Data":"0ff7db553b819b7e46d1e0101a6426df1b5f570619d57197bbfaebc85cad0709"} Sep 18 11:21:55.416476 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.416456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" event={"ID":"a67a86e9-772d-4292-9c1e-6bbeccd71845","Type":"ContainerStarted","Data":"93b9caf8a83b853a2906c1bcadad848c51f59f8ce5c906da4657bc28a644cf2d"} Sep 18 11:21:55.435822 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:55.435783 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k6rq5" podStartSLOduration=2.061391959 podStartE2EDuration="4.435769901s" totalImagesPullingTime="2.374377942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:55.434924306 +0000 UTC m=+37.682828613" watchObservedRunningTime="2026-09-18 11:21:55.435769901 +0000 UTC m=+37.683674206" Sep 18 11:21:56.420845 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.420821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:56.421299 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.420877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:56.421299 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:56.420938 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 11:21:56.421299 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:56.420965 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 11:21:56.421299 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:56.421014 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:58.420995142 +0000 UTC m=+40.668899438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : configmap "kube-rbac-proxy" not found Sep 18 11:21:56.421299 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:56.421032 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:21:58.421022447 +0000 UTC m=+40.668926735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : secret "insights-runtime-extractor-tls" not found Sep 18 11:21:56.575248 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.575224 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-n96f5"] Sep 18 11:21:56.594266 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.594245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-n96f5"] Sep 18 11:21:56.594364 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.594348 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.596968 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.596950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 11:21:56.597082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.597044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tzc96\"" Sep 18 11:21:56.597082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.597042 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 11:21:56.597721 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.597707 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 11:21:56.597784 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.597772 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 11:21:56.617466 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.617440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:56.682632 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.682552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:56.723403 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.723382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-key\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.723504 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.723407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-cabundle\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.723560 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.723534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnnt\" (UniqueName: \"kubernetes.io/projected/5c09b365-d5ef-4411-84af-787a6ac0488c-kube-api-access-bdnnt\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.823952 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.823928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnnt\" (UniqueName: \"kubernetes.io/projected/5c09b365-d5ef-4411-84af-787a6ac0488c-kube-api-access-bdnnt\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.824070 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.824005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-key\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.824070 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.824030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-cabundle\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.824656 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.824628 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-cabundle\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.826851 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.826834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c09b365-d5ef-4411-84af-787a6ac0488c-signing-key\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.837407 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.837384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnnt\" (UniqueName: \"kubernetes.io/projected/5c09b365-d5ef-4411-84af-787a6ac0488c-kube-api-access-bdnnt\") pod \"service-ca-55f6fc7b86-n96f5\" (UID: \"5c09b365-d5ef-4411-84af-787a6ac0488c\") " pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:56.903483 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:56.903466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" Sep 18 11:21:57.203949 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.203718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-n96f5"] Sep 18 11:21:57.206620 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:21:57.206596 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c09b365_d5ef_4411_84af_787a6ac0488c.slice/crio-10aa04578d1fc3c5ec0459a611a8407493355cc23d276fd6d0cee43fa9237d6b WatchSource:0}: Error finding container 10aa04578d1fc3c5ec0459a611a8407493355cc23d276fd6d0cee43fa9237d6b: Status 404 returned error can't find the container with id 10aa04578d1fc3c5ec0459a611a8407493355cc23d276fd6d0cee43fa9237d6b Sep 18 11:21:57.220787 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.220770 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97cp9_ee334868-22e2-4c03-80c9-7bfc3beb2aa9/dns-node-resolver/0.log" Sep 18 11:21:57.422259 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.422217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" event={"ID":"a67a86e9-772d-4292-9c1e-6bbeccd71845","Type":"ContainerStarted","Data":"7b81177a63993bc4406f10705270a45fa58df90862b16f65fdcb15c8470b07b6"} Sep 18 11:21:57.423082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.422284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" event={"ID":"a67a86e9-772d-4292-9c1e-6bbeccd71845","Type":"ContainerStarted","Data":"12c930b17c2a25ca5053a915e907fe8dcd4a9a8a09b07f0d4ede211525e7daed"} Sep 18 11:21:57.423445 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.423427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" event={"ID":"5c09b365-d5ef-4411-84af-787a6ac0488c","Type":"ContainerStarted","Data":"10aa04578d1fc3c5ec0459a611a8407493355cc23d276fd6d0cee43fa9237d6b"} Sep 18 11:21:57.446037 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.445957 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-j7j4q" podStartSLOduration=1.861969721 podStartE2EDuration="3.445940747s" totalImagesPullingTime="1.583971026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:21:57.445903208 +0000 UTC m=+39.693807515" watchObservedRunningTime="2026-09-18 11:21:57.445940747 +0000 UTC m=+39.693845054" Sep 18 11:21:57.719188 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:57.719125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:58.283683 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.283651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:58.367884 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.367850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:58.437259 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.437226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:58.437631 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.437298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:21:58.437631 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:58.437384 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 11:21:58.437631 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:58.437401 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 11:21:58.437631 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:58.437443 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:22:02.437426512 +0000 UTC m=+44.685330810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : secret "insights-runtime-extractor-tls" not found Sep 18 11:21:58.437631 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:58.437460 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:22:02.43745127 +0000 UTC m=+44.685355554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : configmap "kube-rbac-proxy" not found Sep 18 11:21:58.621885 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.621812 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmbpw_1f1d4fbb-ede0-48cf-9c28-d98695ed43da/node-ca/0.log" Sep 18 11:21:58.951727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:58.951656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:21:59.424090 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:59.424067 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6rq5_c6bc485a-1a7e-47d4-89a3-32cc283b0b6e/serve-healthcheck-canary/0.log" Sep 18 11:21:59.443763 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:59.443742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:21:59.444091 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:59.443891 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 11:21:59.444091 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:21:59.443945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls podName:ca6eebff-698f-40e8-94fc-effc82859ada nodeName:}" failed. No retries permitted until 2026-09-18 11:22:07.443931277 +0000 UTC m=+49.691835561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls") pod "dns-default-2626p" (UID: "ca6eebff-698f-40e8-94fc-effc82859ada") : secret "dns-default-metrics-tls" not found Sep 18 11:21:59.621171 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:59.621142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-j7j4q_a67a86e9-772d-4292-9c1e-6bbeccd71845/migrator/0.log" Sep 18 11:21:59.820068 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:21:59.820047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-j7j4q_a67a86e9-772d-4292-9c1e-6bbeccd71845/graceful-termination/0.log" Sep 18 11:22:00.432049 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:00.432014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" event={"ID":"5c09b365-d5ef-4411-84af-787a6ac0488c","Type":"ContainerStarted","Data":"a7eae55da32e887943332fbaa67ff35836ad50b84a38d59b903b4da230762f8d"} Sep 18 11:22:00.784185 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:00.784093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:00.886018 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:00.885969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:01.033081 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:01.033047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:01.134549 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:01.134522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:01.245714 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:01.245684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:01.508192 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:01.508106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:01.989158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:01.989125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:02.466525 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:02.466495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:02.466702 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:02.466577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:02.466702 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:22:02.466683 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 11:22:02.466825 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:22:02.466749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls podName:38866fee-916c-4397-b667-ce7156c469c1 nodeName:}" failed. No retries permitted until 2026-09-18 11:22:10.466731691 +0000 UTC m=+52.714635992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqj6m" (UID: "38866fee-916c-4397-b667-ce7156c469c1") : secret "insights-runtime-extractor-tls" not found Sep 18 11:22:02.467078 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:02.467056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38866fee-916c-4397-b667-ce7156c469c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:02.495508 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:02.495484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:02.901848 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:02.901814 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:03.086690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:03.086658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:03.284765 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:03.284690 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:03.476440 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:03.476405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:04.502511 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:04.502474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:04.603845 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:04.603819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:04.704043 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:04.704005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:05.081708 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:05.081661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:05.281355 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:05.281319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:05.381955 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:05.381929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:05.694392 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:05.694306 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.488388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.488347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.584668 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.584634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.685926 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.685894 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.837527 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.837452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.916952 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.916921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:06.998266 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:06.998236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:07.100313 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.100235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:07.282673 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.282644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:07.497279 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.497250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:07.506325 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.506306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:22:07.509256 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.509241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6eebff-698f-40e8-94fc-effc82859ada-metrics-tls\") pod \"dns-default-2626p\" (UID: \"ca6eebff-698f-40e8-94fc-effc82859ada\") " pod="openshift-dns/dns-default-2626p" Sep 18 11:22:07.535243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.535223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2626p" Sep 18 11:22:07.812371 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.812212 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-n96f5" podStartSLOduration=9.282897757 podStartE2EDuration="11.812187851s" totalImagesPullingTime="2.529290094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:00.449602815 +0000 UTC m=+42.697507122" watchObservedRunningTime="2026-09-18 11:22:07.812187851 +0000 UTC m=+50.060092142" Sep 18 11:22:07.813494 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:07.813473 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2626p"] Sep 18 11:22:07.825081 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:07.825059 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6eebff_698f_40e8_94fc_effc82859ada.slice/crio-5a20c77087a926015802e4495b5de54f74f13682d2ab97bcc407ec85547e3db0 WatchSource:0}: Error finding container 5a20c77087a926015802e4495b5de54f74f13682d2ab97bcc407ec85547e3db0: Status 404 returned error can't find the container with id 5a20c77087a926015802e4495b5de54f74f13682d2ab97bcc407ec85547e3db0 Sep 18 11:22:08.454377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:08.454337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2626p" event={"ID":"ca6eebff-698f-40e8-94fc-effc82859ada","Type":"ContainerStarted","Data":"5a20c77087a926015802e4495b5de54f74f13682d2ab97bcc407ec85547e3db0"} Sep 18 11:22:08.492055 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:08.491943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:08.714413 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:08.714325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:09.100198 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:09.100125 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:09.280258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:09.280220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:09.381145 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:09.381112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:09.689605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:09.689515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:10.293651 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.293625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:10.462540 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.462507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2626p" event={"ID":"ca6eebff-698f-40e8-94fc-effc82859ada","Type":"ContainerStarted","Data":"6fecc36bff8720cf01a24171ca33b4ad0bb3afaf510c80c96afd5bd8e2139f50"} Sep 18 11:22:10.462725 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.462559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2626p" event={"ID":"ca6eebff-698f-40e8-94fc-effc82859ada","Type":"ContainerStarted","Data":"7aba42660b5a48c2b587984b1bc32fedb38f7f0dd34c10983840f296dcb8950a"} Sep 18 11:22:10.462725 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.462662 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2626p" Sep 18 11:22:10.484437 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.484398 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2626p" podStartSLOduration=17.194449419 podStartE2EDuration="19.484383017s" totalImagesPullingTime="2.289933598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:10.482920002 +0000 UTC m=+52.730824308" watchObservedRunningTime="2026-09-18 11:22:10.484383017 +0000 UTC m=+52.732287323" Sep 18 11:22:10.528894 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.528857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:10.531295 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.531273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38866fee-916c-4397-b667-ce7156c469c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqj6m\" (UID: \"38866fee-916c-4397-b667-ce7156c469c1\") " pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:10.642042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.642009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqj6m" Sep 18 11:22:10.876421 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.876392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:10.921272 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:10.921214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqj6m"] Sep 18 11:22:10.924302 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:10.924274 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38866fee_916c_4397_b667_ce7156c469c1.slice/crio-d422660f0e921440befad2d69df3323943066fd9e78700f1fede6f4ad1ebb9b3 WatchSource:0}: Error finding container d422660f0e921440befad2d69df3323943066fd9e78700f1fede6f4ad1ebb9b3: Status 404 returned error can't find the container with id d422660f0e921440befad2d69df3323943066fd9e78700f1fede6f4ad1ebb9b3 Sep 18 11:22:11.075175 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:11.075140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:11.270690 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:11.270614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:11.467826 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:11.467791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqj6m" event={"ID":"38866fee-916c-4397-b667-ce7156c469c1","Type":"ContainerStarted","Data":"9d8ba732c1fd0c369c003adf24119e9ee07e522fd0bfa3c96a74f0e6455f2134"} Sep 18 11:22:11.468003 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:11.467889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqj6m" event={"ID":"38866fee-916c-4397-b667-ce7156c469c1","Type":"ContainerStarted","Data":"d422660f0e921440befad2d69df3323943066fd9e78700f1fede6f4ad1ebb9b3"} Sep 18 11:22:11.500761 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:11.500732 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:12.472937 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:12.472906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqj6m" event={"ID":"38866fee-916c-4397-b667-ce7156c469c1","Type":"ContainerStarted","Data":"76672a44f6d2f4032950e22f2f3304ca2905581490bf3b2353df950d806396d8"} Sep 18 11:22:13.478616 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:13.478584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqj6m" event={"ID":"38866fee-916c-4397-b667-ce7156c469c1","Type":"ContainerStarted","Data":"41d9e5aae3f48cae5514f59079b4712fdc0dc970d21d7b8429cff3b6570379de"} Sep 18 11:22:13.504946 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:13.504902 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xqj6m" podStartSLOduration=17.292557396 podStartE2EDuration="19.504884425s" totalImagesPullingTime="2.212327029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:13.503852692 +0000 UTC m=+55.751756998" watchObservedRunningTime="2026-09-18 11:22:13.504884425 +0000 UTC m=+55.752788730" Sep 18 11:22:14.957250 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:14.957214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.092502 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.092467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.179370 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.179340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.453820 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.453782 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.650322 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.650286 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.758975 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.758888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:15.862360 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:15.862330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:16.428164 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:16.428130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:16.636788 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:16.636750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:16.728022 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:16.727922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:16.967039 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:16.967006 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:17.091730 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.091660 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5"] Sep 18 11:22:17.093872 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.093856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.100227 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.100062 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 11:22:17.100415 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.100392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 11:22:17.100499 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.100396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 11:22:17.104189 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.101501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 11:22:17.104189 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.101720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 11:22:17.104189 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.102176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 11:22:17.104189 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.102649 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 11:22:17.133574 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.133547 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5"] Sep 18 11:22:17.176371 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.176530 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.176530 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4q46\" (UniqueName: \"kubernetes.io/projected/408dff7d-729d-4c2c-aa8c-922d153f6e86-kube-api-access-f4q46\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.176530 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408dff7d-729d-4c2c-aa8c-922d153f6e86-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.176530 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.176680 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.176542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277225 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277408 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4q46\" (UniqueName: \"kubernetes.io/projected/408dff7d-729d-4c2c-aa8c-922d153f6e86-kube-api-access-f4q46\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277408 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408dff7d-729d-4c2c-aa8c-922d153f6e86-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277408 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277408 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.277408 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.277356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.278301 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.278275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/408dff7d-729d-4c2c-aa8c-922d153f6e86-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.279873 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.279840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-ca\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.279972 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.279913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.279972 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.279947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.280165 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.280146 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/408dff7d-729d-4c2c-aa8c-922d153f6e86-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.309155 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.309123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4q46\" (UniqueName: \"kubernetes.io/projected/408dff7d-729d-4c2c-aa8c-922d153f6e86-kube-api-access-f4q46\") pod \"cluster-proxy-proxy-agent-7dbf894b98-5bxq5\" (UID: \"408dff7d-729d-4c2c-aa8c-922d153f6e86\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.348520 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.348427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:17.412650 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.412624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" Sep 18 11:22:17.567688 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.567658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:17.697256 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.697225 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5"] Sep 18 11:22:17.702929 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:17.702901 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod408dff7d_729d_4c2c_aa8c_922d153f6e86.slice/crio-3d1ecb44265b6bb6debd89237811f938a0f7136efe38c6b7b57e1e0a0c089227 WatchSource:0}: Error finding container 3d1ecb44265b6bb6debd89237811f938a0f7136efe38c6b7b57e1e0a0c089227: Status 404 returned error can't find the container with id 3d1ecb44265b6bb6debd89237811f938a0f7136efe38c6b7b57e1e0a0c089227 Sep 18 11:22:17.820704 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.820644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:17.971700 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:17.971613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:18.496396 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:18.496361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" event={"ID":"408dff7d-729d-4c2c-aa8c-922d153f6e86","Type":"ContainerStarted","Data":"3d1ecb44265b6bb6debd89237811f938a0f7136efe38c6b7b57e1e0a0c089227"} Sep 18 11:22:18.560371 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:18.560336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:18.665478 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:18.665431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:18.959561 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:18.959529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:19.040675 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:19.040640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:20.470932 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:20.470899 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2626p" Sep 18 11:22:20.624165 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:20.624132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:20.724092 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:20.723962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:20.966406 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:20.966369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.175045 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.174980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.250883 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.250841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.419357 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.419310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.629655 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.629626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.711027 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.710996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.838642 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.838610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:21.939756 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:21.939726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:22.511417 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:22.511386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" event={"ID":"408dff7d-729d-4c2c-aa8c-922d153f6e86","Type":"ContainerStarted","Data":"5295e16c1ed80864a4e92b96a0d222542fb07198cbc67d0edc832e12c9d0f58d"} Sep 18 11:22:22.511579 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:22.511432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" event={"ID":"408dff7d-729d-4c2c-aa8c-922d153f6e86","Type":"ContainerStarted","Data":"36cceb164fdcb2a89389ffef4e000a65acd349d87bf0f07adeeab79ec3b38f58"} Sep 18 11:22:22.511579 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:22.511448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" event={"ID":"408dff7d-729d-4c2c-aa8c-922d153f6e86","Type":"ContainerStarted","Data":"404d2a6b253800a4c492a7ae403af7645b9626441fd94028c5abdaf73b4403b9"} Sep 18 11:22:22.533945 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:22.533898 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dbf894b98-5bxq5" podStartSLOduration=1.485048269 podStartE2EDuration="5.533879206s" totalImagesPullingTime="4.048830937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:22.533266656 +0000 UTC m=+64.781170961" watchObservedRunningTime="2026-09-18 11:22:22.533879206 +0000 UTC m=+64.781783546" Sep 18 11:22:23.454312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:23.454275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:23.556516 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:23.556478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:24.030305 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.030273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:22:24.030491 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.030326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:22:24.034576 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.034558 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 11:22:24.034644 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.034604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 11:22:24.043046 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.043016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1ea3303-23f9-4d8c-8df7-34704cb6afbb-original-pull-secret\") pod \"global-pull-secret-syncer-8xx7n\" (UID: \"f1ea3303-23f9-4d8c-8df7-34704cb6afbb\") " pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:22:24.043162 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.043086 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2762780d-7603-4e20-b617-a34d482d5ed8-metrics-certs\") pod \"network-metrics-daemon-flfjv\" (UID: \"2762780d-7603-4e20-b617-a34d482d5ed8\") " pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:22:24.053123 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.053104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xx7n" Sep 18 11:22:24.066308 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.066292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmzwd\"" Sep 18 11:22:24.073920 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.073897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-flfjv" Sep 18 11:22:24.074961 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.074939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:24.131762 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.131736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:22:24.135664 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.135634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 11:22:24.144660 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.144604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 11:22:24.155414 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.155360 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbtt\" (UniqueName: \"kubernetes.io/projected/c10be526-101c-4a5a-86a2-82ab9f443bb5-kube-api-access-zmbtt\") pod \"network-check-target-ln924\" (UID: \"c10be526-101c-4a5a-86a2-82ab9f443bb5\") " pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:22:24.185234 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.185207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:24.277601 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.277574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:24.341192 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.341128 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8xx7n"] Sep 18 11:22:24.343931 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:24.343902 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ea3303_23f9_4d8c_8df7_34704cb6afbb.slice/crio-616899c3c8a9b519b46f333fea43d434f437b23989337cc5669e58654ecad51f WatchSource:0}: Error finding container 616899c3c8a9b519b46f333fea43d434f437b23989337cc5669e58654ecad51f: Status 404 returned error can't find the container with id 616899c3c8a9b519b46f333fea43d434f437b23989337cc5669e58654ecad51f Sep 18 11:22:24.345333 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.345312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:24.360873 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.360852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwrtn\"" Sep 18 11:22:24.368898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.368880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:22:24.372093 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.372070 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-flfjv"] Sep 18 11:22:24.375092 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:24.375066 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2762780d_7603_4e20_b617_a34d482d5ed8.slice/crio-e2fb5fe379916e984d18be797d6e4baf7f2039e7beb7ba479348b21f8c70a9b5 WatchSource:0}: Error finding container e2fb5fe379916e984d18be797d6e4baf7f2039e7beb7ba479348b21f8c70a9b5: Status 404 returned error can't find the container with id e2fb5fe379916e984d18be797d6e4baf7f2039e7beb7ba479348b21f8c70a9b5 Sep 18 11:22:24.519528 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.519489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flfjv" event={"ID":"2762780d-7603-4e20-b617-a34d482d5ed8","Type":"ContainerStarted","Data":"e2fb5fe379916e984d18be797d6e4baf7f2039e7beb7ba479348b21f8c70a9b5"} Sep 18 11:22:24.520715 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.520682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8xx7n" event={"ID":"f1ea3303-23f9-4d8c-8df7-34704cb6afbb","Type":"ContainerStarted","Data":"616899c3c8a9b519b46f333fea43d434f437b23989337cc5669e58654ecad51f"} Sep 18 11:22:24.652195 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:24.652168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ln924"] Sep 18 11:22:24.655408 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:24.655382 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10be526_101c_4a5a_86a2_82ab9f443bb5.slice/crio-e10eaab943522ee1da521930a0004a9227e905fe005654f47679759f88fc2198 WatchSource:0}: Error finding container e10eaab943522ee1da521930a0004a9227e905fe005654f47679759f88fc2198: Status 404 returned error can't find the container with id e10eaab943522ee1da521930a0004a9227e905fe005654f47679759f88fc2198 Sep 18 11:22:25.218555 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:25.218518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:25.320329 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:25.320241 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:25.511307 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:25.511221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:25.527235 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:25.527188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ln924" event={"ID":"c10be526-101c-4a5a-86a2-82ab9f443bb5","Type":"ContainerStarted","Data":"e10eaab943522ee1da521930a0004a9227e905fe005654f47679759f88fc2198"} Sep 18 11:22:26.533927 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:26.533833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flfjv" event={"ID":"2762780d-7603-4e20-b617-a34d482d5ed8","Type":"ContainerStarted","Data":"5e22d8f807625eb00e42679bb73de9dd2137e90af36287ea00f4bb7d4adef550"} Sep 18 11:22:26.533927 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:26.533902 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-flfjv" event={"ID":"2762780d-7603-4e20-b617-a34d482d5ed8","Type":"ContainerStarted","Data":"94e26f43cdb5ba9ff9a480c317bbdbce06079e25783173f0e07add3ab95f687d"} Sep 18 11:22:26.556891 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:26.556840 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-flfjv" podStartSLOduration=66.93249419200001 podStartE2EDuration="1m8.556821294s" totalImagesPullingTime="1.624327102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:26.556601879 +0000 UTC m=+68.804506186" watchObservedRunningTime="2026-09-18 11:22:26.556821294 +0000 UTC m=+68.804725600" Sep 18 11:22:26.844760 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:26.844670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:26.989280 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:26.989245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:29.546120 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.546086 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8xx7n" event={"ID":"f1ea3303-23f9-4d8c-8df7-34704cb6afbb","Type":"ContainerStarted","Data":"2aff401518f844d3d6e3d889bcddd3da0c374e78aa9b0a86a1e7ff1dcc2a549d"} Sep 18 11:22:29.547918 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.547889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ln924" event={"ID":"c10be526-101c-4a5a-86a2-82ab9f443bb5","Type":"ContainerStarted","Data":"dd388ef8e65919650ccb572862d88449528328f2481647344c911a578c78ec60"} Sep 18 11:22:29.548038 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.548006 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:22:29.594191 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.594143 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8xx7n" podStartSLOduration=66.583741896 podStartE2EDuration="1m11.594126514s" totalImagesPullingTime="5.010384618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:29.593627778 +0000 UTC m=+71.841532086" watchObservedRunningTime="2026-09-18 11:22:29.594126514 +0000 UTC m=+71.842030820" Sep 18 11:22:29.629064 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.629012 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ln924" podStartSLOduration=66.931412007 podStartE2EDuration="1m11.628976457s" totalImagesPullingTime="4.69756445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:29.627483721 +0000 UTC m=+71.875388029" watchObservedRunningTime="2026-09-18 11:22:29.628976457 +0000 UTC m=+71.876880764" Sep 18 11:22:29.789164 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.789134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:29.963633 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:29.963549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:30.124292 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:30.124265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:30.245502 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:30.245419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:33.336979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:33.336940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:33.445183 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:33.445142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:36.863186 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:36.863143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:36.968665 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:36.968631 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:37.667031 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:37.667000 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:37.769750 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:37.769711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:39.635059 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:39.634913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:40.755061 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:40.755028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:40.911824 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:40.911790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.116177 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.116081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.241564 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.241530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.400202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.400168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.508596 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.508564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.695664 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.695576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.795441 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.795407 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c2tt5"] Sep 18 11:22:41.799309 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.799289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.804160 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.804140 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 11:22:41.804377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.804358 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 11:22:41.806540 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.806522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wl6d6\"" Sep 18 11:22:41.807066 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.807046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 11:22:41.807532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.807067 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 11:22:41.807621 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.807197 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 11:22:41.807905 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.807887 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 11:22:41.850394 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.850357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.856403 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856544 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-root\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856544 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-sys\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856544 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856544 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-textfile\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856544 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-wtmp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856708 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-tls\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856708 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-metrics-client-ca\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.856708 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.856602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrtp\" (UniqueName: \"kubernetes.io/projected/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-kube-api-access-rcrtp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.944053 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.944009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:41.958071 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-sys\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958071 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-textfile\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-wtmp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-sys\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-tls\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-metrics-client-ca\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrtp\" (UniqueName: \"kubernetes.io/projected/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-kube-api-access-rcrtp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958258 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-wtmp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958659 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-root\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958659 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-root\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958659 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-textfile\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.958876 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.958858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-metrics-client-ca\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.959052 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.959030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.960685 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.960654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.960959 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.960940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-node-exporter-tls\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:41.971281 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:41.971254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrtp\" (UniqueName: \"kubernetes.io/projected/6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9-kube-api-access-rcrtp\") pod \"node-exporter-c2tt5\" (UID: \"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9\") " pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:42.110311 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.110272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c2tt5" Sep 18 11:22:42.120362 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:42.120329 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd6a90f_f29b_48b5_9ee1_8421b5ce70d9.slice/crio-6d747b7d632cbb9e1079a7e68f1e01862b8764b6bd42895c2663fb7e66ecb0ca WatchSource:0}: Error finding container 6d747b7d632cbb9e1079a7e68f1e01862b8764b6bd42895c2663fb7e66ecb0ca: Status 404 returned error can't find the container with id 6d747b7d632cbb9e1079a7e68f1e01862b8764b6bd42895c2663fb7e66ecb0ca Sep 18 11:22:42.144146 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.144119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.241193 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.241090 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.447785 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.447746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.589596 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.589512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c2tt5" event={"ID":"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9","Type":"ContainerStarted","Data":"6d747b7d632cbb9e1079a7e68f1e01862b8764b6bd42895c2663fb7e66ecb0ca"} Sep 18 11:22:42.657044 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.657005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.755019 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.754548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.879095 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.879027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:42.963711 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:42.963675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:43.095202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:43.095177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:43.594759 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:43.594667 2579 generic.go:356] "Generic (PLEG): container finished" podID="6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9" containerID="d27af614a20e97d0924dee36b3f84a8f7e65c0d95aaf91df45e3d8352c2877e4" exitCode=0 Sep 18 11:22:43.594904 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:43.594761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c2tt5" event={"ID":"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9","Type":"ContainerDied","Data":"d27af614a20e97d0924dee36b3f84a8f7e65c0d95aaf91df45e3d8352c2877e4"} Sep 18 11:22:44.600386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.600354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c2tt5" event={"ID":"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9","Type":"ContainerStarted","Data":"b9c2eec309264ddc3b1499f13d107c24675eca0ba232b3beea0967045225781d"} Sep 18 11:22:44.600761 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.600405 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c2tt5" event={"ID":"6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9","Type":"ContainerStarted","Data":"822ad43c16ae57cb624779a69292d9cb84f7d5372d34880c3ece3cac75fdaf03"} Sep 18 11:22:44.626684 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.626637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c2tt5" podStartSLOduration=2.591722637 podStartE2EDuration="3.626618421s" totalImagesPullingTime="962.842295ms" totalInitContainerRuntime="72.053489ms" isStatefulPod=true podCreationTimestamp="2026-09-18 11:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:44.625001318 +0000 UTC m=+86.872905618" watchObservedRunningTime="2026-09-18 11:22:44.626618421 +0000 UTC m=+86.874522778" Sep 18 11:22:44.682645 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.682608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:44.786516 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.786465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:44.884345 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.884317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:44.983472 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:44.983435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.101241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.101210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.201713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.201684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.257900 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.257871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b49cc8fdc-f92lx"] Sep 18 11:22:46.260086 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.260070 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.269559 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.269538 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 11:22:46.269929 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.269914 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 11:22:46.270193 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.270175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 11:22:46.270293 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.270264 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q8w2c\"" Sep 18 11:22:46.271222 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.271206 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-21lg8hovtvt5d\"" Sep 18 11:22:46.271389 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.271377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 11:22:46.344761 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.344730 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b49cc8fdc-f92lx"] Sep 18 11:22:46.393275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-tls\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393430 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393430 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-metrics-server-audit-profiles\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393430 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-client-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393430 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e47d4cc4-dc84-4952-a80e-9a05191d73b1-audit-log\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393553 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-client-certs\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.393553 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.393460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrqr\" (UniqueName: \"kubernetes.io/projected/e47d4cc4-dc84-4952-a80e-9a05191d73b1-kube-api-access-lvrqr\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.481976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.481940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.488902 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.488871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt"] Sep 18 11:22:46.491343 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.491326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.494013 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.493950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-tls\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494146 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494146 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-metrics-server-audit-profiles\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494146 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-client-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494302 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e47d4cc4-dc84-4952-a80e-9a05191d73b1-audit-log\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494302 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-client-certs\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494302 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494201 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mjdjk\"" Sep 18 11:22:46.494302 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrqr\" (UniqueName: \"kubernetes.io/projected/e47d4cc4-dc84-4952-a80e-9a05191d73b1-kube-api-access-lvrqr\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e47d4cc4-dc84-4952-a80e-9a05191d73b1-audit-log\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.494854 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.494828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.495185 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.495165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 11:22:46.495366 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.495218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e47d4cc4-dc84-4952-a80e-9a05191d73b1-metrics-server-audit-profiles\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.496874 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.496853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-client-ca-bundle\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.497083 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.497051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-tls\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.497247 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.497232 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e47d4cc4-dc84-4952-a80e-9a05191d73b1-secret-metrics-server-client-certs\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.500530 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.500509 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt"] Sep 18 11:22:46.507364 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.507341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrqr\" (UniqueName: \"kubernetes.io/projected/e47d4cc4-dc84-4952-a80e-9a05191d73b1-kube-api-access-lvrqr\") pod \"metrics-server-6b49cc8fdc-f92lx\" (UID: \"e47d4cc4-dc84-4952-a80e-9a05191d73b1\") " pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.568940 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.568901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:22:46.570717 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.570690 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.595276 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.595244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.595436 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.595281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbvq\" (UniqueName: \"kubernetes.io/projected/e9823098-4aec-496c-b334-7ba0abf44c8a-kube-api-access-tnbvq\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.696320 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.696233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.696320 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.696275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbvq\" (UniqueName: \"kubernetes.io/projected/e9823098-4aec-496c-b334-7ba0abf44c8a-kube-api-access-tnbvq\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.696508 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:22:46.696394 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 11:22:46.696508 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:22:46.696465 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert podName:e9823098-4aec-496c-b334-7ba0abf44c8a nodeName:}" failed. No retries permitted until 2026-09-18 11:22:47.196444016 +0000 UTC m=+89.444348300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-ngmpt" (UID: "e9823098-4aec-496c-b334-7ba0abf44c8a") : secret "monitoring-plugin-cert" not found Sep 18 11:22:46.706415 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.706385 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbvq\" (UniqueName: \"kubernetes.io/projected/e9823098-4aec-496c-b334-7ba0abf44c8a-kube-api-access-tnbvq\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:46.772225 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.772190 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:46.844976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:46.844943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b49cc8fdc-f92lx"] Sep 18 11:22:46.848160 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:46.848136 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47d4cc4_dc84_4952_a80e_9a05191d73b1.slice/crio-63061fb7664fe0f560ff2e13b2fff49cec27db4f66ebe7fa6545987eb4140939 WatchSource:0}: Error finding container 63061fb7664fe0f560ff2e13b2fff49cec27db4f66ebe7fa6545987eb4140939: Status 404 returned error can't find the container with id 63061fb7664fe0f560ff2e13b2fff49cec27db4f66ebe7fa6545987eb4140939 Sep 18 11:22:47.200537 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.200490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:47.202996 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.202964 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e9823098-4aec-496c-b334-7ba0abf44c8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ngmpt\" (UID: \"e9823098-4aec-496c-b334-7ba0abf44c8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:47.323596 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.323552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:47.413904 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.413870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:47.447947 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.447912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:47.613237 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.613196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" event={"ID":"e47d4cc4-dc84-4952-a80e-9a05191d73b1","Type":"ContainerStarted","Data":"63061fb7664fe0f560ff2e13b2fff49cec27db4f66ebe7fa6545987eb4140939"} Sep 18 11:22:47.690880 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:47.690825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt"] Sep 18 11:22:47.694312 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:22:47.694271 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9823098_4aec_496c_b334_7ba0abf44c8a.slice/crio-68ae6956ddaa072aa0f9dae105be5e602781af09a2042f3a5bf8f99e2211c1c0 WatchSource:0}: Error finding container 68ae6956ddaa072aa0f9dae105be5e602781af09a2042f3a5bf8f99e2211c1c0: Status 404 returned error can't find the container with id 68ae6956ddaa072aa0f9dae105be5e602781af09a2042f3a5bf8f99e2211c1c0 Sep 18 11:22:48.139741 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:48.139707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:48.618676 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:48.618591 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" event={"ID":"e9823098-4aec-496c-b334-7ba0abf44c8a","Type":"ContainerStarted","Data":"68ae6956ddaa072aa0f9dae105be5e602781af09a2042f3a5bf8f99e2211c1c0"} Sep 18 11:22:48.620713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:48.620682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" event={"ID":"e47d4cc4-dc84-4952-a80e-9a05191d73b1","Type":"ContainerStarted","Data":"aed51a860e5bf9ecdd8293e1d716757041b04dc147849f8cb113399578f9681d"} Sep 18 11:22:48.643762 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:48.643696 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" podStartSLOduration=1.186280549 podStartE2EDuration="2.64367277s" totalImagesPullingTime="1.457392221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:48.643629936 +0000 UTC m=+90.891534243" watchObservedRunningTime="2026-09-18 11:22:48.64367277 +0000 UTC m=+90.891577079" Sep 18 11:22:49.626472 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:49.626440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" event={"ID":"e9823098-4aec-496c-b334-7ba0abf44c8a","Type":"ContainerStarted","Data":"55c5ee05add657f39d4b3a4e471417a423068eb6d2a3e78d33ba6d520d120c00"} Sep 18 11:22:49.644346 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:49.644293 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" podStartSLOduration=2.166628884 podStartE2EDuration="3.644275566s" totalImagesPullingTime="1.477646682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:22:49.643097117 +0000 UTC m=+91.891001426" watchObservedRunningTime="2026-09-18 11:22:49.644275566 +0000 UTC m=+91.892179875" Sep 18 11:22:49.679275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:49.679237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:49.775695 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:49.775651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:50.630047 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:50.630012 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:50.634829 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:50.634804 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ngmpt" Sep 18 11:22:51.828587 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:51.828550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:51.894872 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:51.894834 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:58.242749 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:58.242715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:58.344548 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:58.344518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:22:58.415115 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:22:58.415065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:00.556798 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:00.556770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ln924" Sep 18 11:23:05.576312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:05.576279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6rq5_c6bc485a-1a7e-47d4-89a3-32cc283b0b6e/serve-healthcheck-canary/0.log" Sep 18 11:23:06.569113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:06.569076 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:23:06.569301 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:06.569139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:23:06.841922 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:06.841838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:06.926540 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:06.926497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:14.678756 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:14.678713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:14.884799 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:14.884762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:14.984511 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:14.984423 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:23:26.575184 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:26.575153 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:23:26.579268 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:26.579239 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b49cc8fdc-f92lx" Sep 18 11:23:27.733551 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:23:27.733515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:01.087054 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:01.087007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:01.213979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:01.213942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:10.510377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:10.510294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:21.574645 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:21.574597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:21.675605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:21.675571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:22.171326 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:22.171287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:35.782507 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:35.782467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:35.872765 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:35.872728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:24:43.522236 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:24:43.522200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:16.416727 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:16.416694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:16.554396 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:16.554367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:28.365252 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:28.365217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:28.442575 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:28.442553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:36.445599 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:36.445563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:36.594293 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:36.594258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:36.664057 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:36.664023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:36.852081 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:36.851979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:36.945524 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:36.945496 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:37.046140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:37.046106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:37.204091 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:37.204061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:37.314610 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:37.314550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:47.832715 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:47.832624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:47.934743 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:47.934708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:25:48.000467 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:25:48.000435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:10.410641 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:10.410598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:10.574937 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:10.574897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:12.179595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.179564 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l"] Sep 18 11:26:12.182627 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.182612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.185710 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.185692 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 11:26:12.186933 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.186915 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 11:26:12.187010 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.186958 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-58r9m\"" Sep 18 11:26:12.197154 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.197135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l"] Sep 18 11:26:12.221703 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.221680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.221800 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.221713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.221800 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.221730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9whqh\" (UniqueName: \"kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.322939 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.322915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.323065 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.322945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.323065 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.322964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9whqh\" (UniqueName: \"kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.323286 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.323268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.323352 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.323305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.332235 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.332210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9whqh\" (UniqueName: \"kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.490891 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.490842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:12.786889 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:12.786867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l"] Sep 18 11:26:12.788607 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:26:12.788577 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7d8cce_80c0_4ee8_bb47_696ee5abdf27.slice/crio-7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488 WatchSource:0}: Error finding container 7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488: Status 404 returned error can't find the container with id 7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488 Sep 18 11:26:13.302799 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:13.302763 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerStarted","Data":"7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488"} Sep 18 11:26:18.638156 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:18.638118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:26:18.640208 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:18.638521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:26:18.642584 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:18.642567 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 11:26:19.325809 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:19.325775 2579 generic.go:356] "Generic (PLEG): container finished" podID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerID="8e9e3e4f8bc257a589c488de71c99d19c3c6f10f7eda9fa1a282b97cdf3a9cb5" exitCode=0 Sep 18 11:26:19.326061 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:19.325830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerDied","Data":"8e9e3e4f8bc257a589c488de71c99d19c3c6f10f7eda9fa1a282b97cdf3a9cb5"} Sep 18 11:26:21.334437 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:21.334406 2579 generic.go:356] "Generic (PLEG): container finished" podID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerID="5e6433a2ea61f114a1020800dafc2517e6780a4db73cb0f0bacb05494d8a02b5" exitCode=0 Sep 18 11:26:21.334801 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:21.334483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerDied","Data":"5e6433a2ea61f114a1020800dafc2517e6780a4db73cb0f0bacb05494d8a02b5"} Sep 18 11:26:21.335461 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:21.335445 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 11:26:28.361972 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:28.361933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerStarted","Data":"b4d52f0b632e4999e68325e4ccaa67b1d4f53186f2143b48778f355e67d1247a"} Sep 18 11:26:29.367221 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:29.367191 2579 generic.go:356] "Generic (PLEG): container finished" podID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerID="b4d52f0b632e4999e68325e4ccaa67b1d4f53186f2143b48778f355e67d1247a" exitCode=0 Sep 18 11:26:29.367579 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:29.367252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerDied","Data":"b4d52f0b632e4999e68325e4ccaa67b1d4f53186f2143b48778f355e67d1247a"} Sep 18 11:26:30.494186 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.494165 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:30.566857 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.566819 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle\") pod \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " Sep 18 11:26:30.567074 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.566918 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util\") pod \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " Sep 18 11:26:30.567074 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.566946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9whqh\" (UniqueName: \"kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh\") pod \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\" (UID: \"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27\") " Sep 18 11:26:30.567504 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.567483 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle" (OuterVolumeSpecName: "bundle") pod "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" (UID: "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 11:26:30.569169 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.569148 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh" (OuterVolumeSpecName: "kube-api-access-9whqh") pod "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" (UID: "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27"). InnerVolumeSpecName "kube-api-access-9whqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:26:30.571230 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.571207 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util" (OuterVolumeSpecName: "util") pod "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" (UID: "bb7d8cce-80c0-4ee8-bb47-696ee5abdf27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 11:26:30.667671 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.667638 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:26:30.667671 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.667665 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-util\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:26:30.667671 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:30.667674 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9whqh\" (UniqueName: \"kubernetes.io/projected/bb7d8cce-80c0-4ee8-bb47-696ee5abdf27-kube-api-access-9whqh\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:26:31.376312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:31.376275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" event={"ID":"bb7d8cce-80c0-4ee8-bb47-696ee5abdf27","Type":"ContainerDied","Data":"7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488"} Sep 18 11:26:31.376473 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:31.376321 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mx75l" Sep 18 11:26:31.376473 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:31.376331 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7658496940f362fc05a7bb07d5ee1be998a7831ea126bb9b03d0a9e8cdbb4488" Sep 18 11:26:33.413680 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:33.413645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:34.831425 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:34.831386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:37.356631 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:37.356592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:37.460332 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:37.460289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:39.541771 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.541736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:39.637768 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.637729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:39.666570 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666538 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkq9v"] Sep 18 11:26:39.666794 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666783 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="pull" Sep 18 11:26:39.666834 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666796 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="pull" Sep 18 11:26:39.666834 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666810 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="util" Sep 18 11:26:39.666834 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666815 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="util" Sep 18 11:26:39.666834 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666823 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="extract" Sep 18 11:26:39.666834 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666828 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="extract" Sep 18 11:26:39.666979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.666865 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7d8cce-80c0-4ee8-bb47-696ee5abdf27" containerName="extract" Sep 18 11:26:39.677116 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.677098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.679556 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.679536 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 11:26:39.680164 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.680142 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkq9v"] Sep 18 11:26:39.680585 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.680571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 11:26:39.831288 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.831200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.831288 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.831272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qs4\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-kube-api-access-c6qs4\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.932463 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.932423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.932639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.932484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qs4\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-kube-api-access-c6qs4\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.944863 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.944825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qs4\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-kube-api-access-c6qs4\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.945377 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.945359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/933e65b7-6d68-4f1f-af23-2fa0cbe8cc70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkq9v\" (UID: \"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:39.987499 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:39.987456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:40.309754 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:26:40.309727 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod933e65b7_6d68_4f1f_af23_2fa0cbe8cc70.slice/crio-7ed44c4b085b9af70a66d5cab05495dfac870a7a3132f4cd9dbd2eea9f1e5f80 WatchSource:0}: Error finding container 7ed44c4b085b9af70a66d5cab05495dfac870a7a3132f4cd9dbd2eea9f1e5f80: Status 404 returned error can't find the container with id 7ed44c4b085b9af70a66d5cab05495dfac870a7a3132f4cd9dbd2eea9f1e5f80 Sep 18 11:26:40.310090 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:40.310059 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkq9v"] Sep 18 11:26:40.311008 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:40.310947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:40.406797 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:40.406766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" event={"ID":"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70","Type":"ContainerStarted","Data":"7ed44c4b085b9af70a66d5cab05495dfac870a7a3132f4cd9dbd2eea9f1e5f80"} Sep 18 11:26:40.518091 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:40.518059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:41.463620 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:41.463569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:41.990569 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:41.990500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:42.204633 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.204597 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn"] Sep 18 11:26:42.206978 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.206952 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.209372 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.209350 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l7mbh\"" Sep 18 11:26:42.226642 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.226615 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn"] Sep 18 11:26:42.351528 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.351453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcs5\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-kube-api-access-5zcs5\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.351528 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.351513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.452878 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.452840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.453039 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.452917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcs5\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-kube-api-access-5zcs5\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.464353 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.464330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.464713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.464487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcs5\" (UniqueName: \"kubernetes.io/projected/d3983422-5735-4247-8315-3de65cb13d14-kube-api-access-5zcs5\") pod \"cert-manager-cainjector-559cdd8c87-8d5gn\" (UID: \"d3983422-5735-4247-8315-3de65cb13d14\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:42.516948 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:42.516920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" Sep 18 11:26:43.231794 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.231620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn"] Sep 18 11:26:43.234165 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:26:43.234140 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3983422_5735_4247_8315_3de65cb13d14.slice/crio-c9d3d045926e860be6937177d5c551b5a089a07ac8a138301af78a7d0bf19886 WatchSource:0}: Error finding container c9d3d045926e860be6937177d5c551b5a089a07ac8a138301af78a7d0bf19886: Status 404 returned error can't find the container with id c9d3d045926e860be6937177d5c551b5a089a07ac8a138301af78a7d0bf19886 Sep 18 11:26:43.421187 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.421150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" event={"ID":"933e65b7-6d68-4f1f-af23-2fa0cbe8cc70","Type":"ContainerStarted","Data":"ec3ffdef717fb2404dff59d892a14c97a7725ed83ae3b1640764e28bdeb20558"} Sep 18 11:26:43.421376 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.421235 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:43.423032 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.423009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" event={"ID":"d3983422-5735-4247-8315-3de65cb13d14","Type":"ContainerStarted","Data":"19db414b151f1a61fe3788926bc007b1812e5d48ce28c777b1df31737d6222e9"} Sep 18 11:26:43.423143 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.423037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" event={"ID":"d3983422-5735-4247-8315-3de65cb13d14","Type":"ContainerStarted","Data":"c9d3d045926e860be6937177d5c551b5a089a07ac8a138301af78a7d0bf19886"} Sep 18 11:26:43.449467 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.449430 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" podStartSLOduration=1.761522536 podStartE2EDuration="4.449389379s" totalImagesPullingTime="2.687866843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:26:43.447141329 +0000 UTC m=+325.695045633" watchObservedRunningTime="2026-09-18 11:26:43.449389379 +0000 UTC m=+325.697293684" Sep 18 11:26:43.551925 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:43.551842 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8d5gn" podStartSLOduration=1.551827227 podStartE2EDuration="1.551827227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:26:43.549643941 +0000 UTC m=+325.797548247" watchObservedRunningTime="2026-09-18 11:26:43.551827227 +0000 UTC m=+325.799731531" Sep 18 11:26:44.018862 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:44.018831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:44.120223 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:44.120187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:49.428892 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:49.428867 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkq9v" Sep 18 11:26:50.800691 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:50.800659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:59.551493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:59.551451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:26:59.629323 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:26:59.629294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:00.542618 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.542586 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsshw"] Sep 18 11:27:00.544896 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.544880 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.549346 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.549323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cvvdv\"" Sep 18 11:27:00.558749 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.558720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsshw"] Sep 18 11:27:00.673436 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.673404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gn8\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-kube-api-access-l2gn8\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.673436 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.673441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.774227 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.774191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gn8\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-kube-api-access-l2gn8\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.774227 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.774229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.785755 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.785732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.785914 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.785895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gn8\" (UniqueName: \"kubernetes.io/projected/e6d8142a-4a33-428e-b407-14f407b256db-kube-api-access-l2gn8\") pod \"cert-manager-55b4d954d5-hsshw\" (UID: \"e6d8142a-4a33-428e-b407-14f407b256db\") " pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:00.853889 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:00.853803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsshw" Sep 18 11:27:01.129733 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.129701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsshw"] Sep 18 11:27:01.133258 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:01.133232 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6d8142a_4a33_428e_b407_14f407b256db.slice/crio-3434ff104a780c5bc736a2bd14c6f271ce1d1b7e7b7da6ec68edc1ed1602fa98 WatchSource:0}: Error finding container 3434ff104a780c5bc736a2bd14c6f271ce1d1b7e7b7da6ec68edc1ed1602fa98: Status 404 returned error can't find the container with id 3434ff104a780c5bc736a2bd14c6f271ce1d1b7e7b7da6ec68edc1ed1602fa98 Sep 18 11:27:01.260507 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.260460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:01.359458 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.359426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:01.489324 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.489239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsshw" event={"ID":"e6d8142a-4a33-428e-b407-14f407b256db","Type":"ContainerStarted","Data":"2acad25513b896aab863062f2e2b8e9bdba0cd14675472142e68f50a2b146be7"} Sep 18 11:27:01.489324 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.489275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsshw" event={"ID":"e6d8142a-4a33-428e-b407-14f407b256db","Type":"ContainerStarted","Data":"3434ff104a780c5bc736a2bd14c6f271ce1d1b7e7b7da6ec68edc1ed1602fa98"} Sep 18 11:27:01.518763 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:01.518712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hsshw" podStartSLOduration=1.518698375 podStartE2EDuration="1.518698375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:27:01.516445529 +0000 UTC m=+343.764349836" watchObservedRunningTime="2026-09-18 11:27:01.518698375 +0000 UTC m=+343.766602682" Sep 18 11:27:06.728109 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:06.728071 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:06.857295 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:06.857249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:08.374437 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.374407 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz"] Sep 18 11:27:08.376801 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.376785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.379644 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.379622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-58r9m\"" Sep 18 11:27:08.379762 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.379623 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 11:27:08.380457 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.380438 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 11:27:08.387635 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.387606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz"] Sep 18 11:27:08.528297 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.528258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.528297 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.528290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.528521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.528327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgfkl\" (UniqueName: \"kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.628892 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.628822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgfkl\" (UniqueName: \"kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.628892 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.628885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.629064 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.628902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.629252 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.629237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.629303 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.629284 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.638236 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.638215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgfkl\" (UniqueName: \"kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.686178 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.686147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:08.952018 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.951915 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:08.958858 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:08.958749 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz"] Sep 18 11:27:08.960842 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:08.960821 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f620dc_f44d_49ae_90b3_c82d214b0fa0.slice/crio-6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114 WatchSource:0}: Error finding container 6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114: Status 404 returned error can't find the container with id 6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114 Sep 18 11:27:09.521521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:09.521470 2579 generic.go:356] "Generic (PLEG): container finished" podID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerID="2349dffa6f0b936d41d93b53eca765b1fae8b0aace8a09154d9017ece1915860" exitCode=0 Sep 18 11:27:09.521901 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:09.521536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" event={"ID":"c4f620dc-f44d-49ae-90b3-c82d214b0fa0","Type":"ContainerDied","Data":"2349dffa6f0b936d41d93b53eca765b1fae8b0aace8a09154d9017ece1915860"} Sep 18 11:27:09.521901 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:09.521589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" event={"ID":"c4f620dc-f44d-49ae-90b3-c82d214b0fa0","Type":"ContainerStarted","Data":"6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114"} Sep 18 11:27:10.527359 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:10.527282 2579 generic.go:356] "Generic (PLEG): container finished" podID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerID="67594d197705856b196edd9806159edb24faad1cf2e7f097697ed84c41fc8e00" exitCode=0 Sep 18 11:27:10.527763 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:10.527368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" event={"ID":"c4f620dc-f44d-49ae-90b3-c82d214b0fa0","Type":"ContainerDied","Data":"67594d197705856b196edd9806159edb24faad1cf2e7f097697ed84c41fc8e00"} Sep 18 11:27:11.534715 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:11.534683 2579 generic.go:356] "Generic (PLEG): container finished" podID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerID="167e3d27f32e6b168e30e1714f2249d9146ae0559633ce7fc5fe2c4b11ee3b12" exitCode=0 Sep 18 11:27:11.535103 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:11.534743 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" event={"ID":"c4f620dc-f44d-49ae-90b3-c82d214b0fa0","Type":"ContainerDied","Data":"167e3d27f32e6b168e30e1714f2249d9146ae0559633ce7fc5fe2c4b11ee3b12"} Sep 18 11:27:12.660889 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.660867 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:12.762254 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.762222 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util\") pod \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " Sep 18 11:27:12.762434 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.762270 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle\") pod \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " Sep 18 11:27:12.762434 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.762302 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgfkl\" (UniqueName: \"kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl\") pod \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\" (UID: \"c4f620dc-f44d-49ae-90b3-c82d214b0fa0\") " Sep 18 11:27:12.763035 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.762981 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle" (OuterVolumeSpecName: "bundle") pod "c4f620dc-f44d-49ae-90b3-c82d214b0fa0" (UID: "c4f620dc-f44d-49ae-90b3-c82d214b0fa0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 11:27:12.764443 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.764418 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl" (OuterVolumeSpecName: "kube-api-access-qgfkl") pod "c4f620dc-f44d-49ae-90b3-c82d214b0fa0" (UID: "c4f620dc-f44d-49ae-90b3-c82d214b0fa0"). InnerVolumeSpecName "kube-api-access-qgfkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:27:12.768044 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.768024 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util" (OuterVolumeSpecName: "util") pod "c4f620dc-f44d-49ae-90b3-c82d214b0fa0" (UID: "c4f620dc-f44d-49ae-90b3-c82d214b0fa0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 11:27:12.863042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.862952 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-util\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:27:12.863042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.862980 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-bundle\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:27:12.863042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:12.863005 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgfkl\" (UniqueName: \"kubernetes.io/projected/c4f620dc-f44d-49ae-90b3-c82d214b0fa0-kube-api-access-qgfkl\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:27:13.544788 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:13.544748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" event={"ID":"c4f620dc-f44d-49ae-90b3-c82d214b0fa0","Type":"ContainerDied","Data":"6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114"} Sep 18 11:27:13.544788 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:13.544766 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af44wbz" Sep 18 11:27:13.544788 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:13.544794 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b05294cafd5ba4794bc5bd6650ece0de5ebd13b0b42ebf4647b51dc5738a114" Sep 18 11:27:20.364740 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:20.364706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:20.511780 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:20.511746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:21.106821 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:21.106793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:21.959034 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:21.958981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:22.120559 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.120521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:22.170852 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.170822 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z"] Sep 18 11:27:22.171092 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171081 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="pull" Sep 18 11:27:22.171137 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171094 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="pull" Sep 18 11:27:22.171137 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171104 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="util" Sep 18 11:27:22.171137 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171109 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="util" Sep 18 11:27:22.171137 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171123 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="extract" Sep 18 11:27:22.171137 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171128 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="extract" Sep 18 11:27:22.171283 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.171173 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f620dc-f44d-49ae-90b3-c82d214b0fa0" containerName="extract" Sep 18 11:27:22.173909 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.173895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.179540 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.179508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 11:27:22.179698 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.179588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 11:27:22.179946 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.179929 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 18 11:27:22.192395 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.192371 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qmcbb\"" Sep 18 11:27:22.194242 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.194229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 18 11:27:22.211354 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.211291 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z"] Sep 18 11:27:22.231115 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.231084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.231238 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.231126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-manifests\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.231238 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.231146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/a2e9111a-b476-46ec-9776-ce9aa2c6120a-kube-api-access-g72s6\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.231238 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.231214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.231336 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.231244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-tmp\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-manifests\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/a2e9111a-b476-46ec-9776-ce9aa2c6120a-kube-api-access-g72s6\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-tmp\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.332706 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.332621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-manifests\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.334770 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.334748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2e9111a-b476-46ec-9776-ce9aa2c6120a-tmp\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.335124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.335102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.335202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.335127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a2e9111a-b476-46ec-9776-ce9aa2c6120a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.349517 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.349497 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72s6\" (UniqueName: \"kubernetes.io/projected/a2e9111a-b476-46ec-9776-ce9aa2c6120a-kube-api-access-g72s6\") pod \"opendatahub-operator-controller-manager-86d7cf8495-bx52z\" (UID: \"a2e9111a-b476-46ec-9776-ce9aa2c6120a\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.484114 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.484010 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:22.585379 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.585341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:22.733253 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.733218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:22.792685 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.792664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z"] Sep 18 11:27:22.795361 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:22.795329 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e9111a_b476_46ec_9776_ce9aa2c6120a.slice/crio-6de94bc765d307dffad32a14db306966e610c1672c9ab11a434aaff5d4a6cab5 WatchSource:0}: Error finding container 6de94bc765d307dffad32a14db306966e610c1672c9ab11a434aaff5d4a6cab5: Status 404 returned error can't find the container with id 6de94bc765d307dffad32a14db306966e610c1672c9ab11a434aaff5d4a6cab5 Sep 18 11:27:22.901572 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:22.901535 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:23.061900 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:23.061815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:23.264475 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:23.264446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:23.586714 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:23.586644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" event={"ID":"a2e9111a-b476-46ec-9776-ce9aa2c6120a","Type":"ContainerStarted","Data":"6de94bc765d307dffad32a14db306966e610c1672c9ab11a434aaff5d4a6cab5"} Sep 18 11:27:24.364505 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:24.364467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:24.473027 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:24.472961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:26.600175 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:26.600137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" event={"ID":"a2e9111a-b476-46ec-9776-ce9aa2c6120a","Type":"ContainerStarted","Data":"13b8c009c98b4e74c286344d134ddf9a0ca8fc9a0a6b2734f18a191fc1f937eb"} Sep 18 11:27:27.605406 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:27.605371 2579 generic.go:356] "Generic (PLEG): container finished" podID="a2e9111a-b476-46ec-9776-ce9aa2c6120a" containerID="13b8c009c98b4e74c286344d134ddf9a0ca8fc9a0a6b2734f18a191fc1f937eb" exitCode=0 Sep 18 11:27:27.605814 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:27.605457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" event={"ID":"a2e9111a-b476-46ec-9776-ce9aa2c6120a","Type":"ContainerDied","Data":"13b8c009c98b4e74c286344d134ddf9a0ca8fc9a0a6b2734f18a191fc1f937eb"} Sep 18 11:27:28.611732 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:28.611695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" event={"ID":"a2e9111a-b476-46ec-9776-ce9aa2c6120a","Type":"ContainerStarted","Data":"715f61dfe7c0493f8619b5cb039c10c33fc95db979fd7a76f84d10932b5eb287"} Sep 18 11:27:28.612115 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:28.611805 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:28.643129 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:28.643081 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" podStartSLOduration=2.414779998 podStartE2EDuration="6.643066201s" totalImagesPullingTime="3.160015193s" totalInitContainerRuntime="1.06827101s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:27:28.640331757 +0000 UTC m=+370.888236064" watchObservedRunningTime="2026-09-18 11:27:28.643066201 +0000 UTC m=+370.890970507" Sep 18 11:27:30.066620 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:30.066585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:30.167181 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:30.167141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:34.224573 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:34.224510 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:34.305614 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:34.305576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:34.665372 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:34.665326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:34.735729 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:34.735703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:35.296414 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:35.296377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:35.433270 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:35.433233 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:35.575113 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:35.575027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:39.619552 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:39.619519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7cf8495-bx52z" Sep 18 11:27:41.946439 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:41.946383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:42.250796 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.250707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:42.522836 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.522737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:42.560852 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.560823 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k"] Sep 18 11:27:42.564085 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.564060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.592082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.592047 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 11:27:42.592082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.592054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 18 11:27:42.592082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.592082 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 18 11:27:42.592945 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.592934 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 11:27:42.593011 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.592959 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-59vcf\"" Sep 18 11:27:42.639999 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.639952 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k"] Sep 18 11:27:42.684822 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.684794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllpj\" (UniqueName: \"kubernetes.io/projected/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-kube-api-access-nllpj\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.685024 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.684833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.685024 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.684852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tmp\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.786252 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.786157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tmp\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.786420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.786254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllpj\" (UniqueName: \"kubernetes.io/projected/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-kube-api-access-nllpj\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.786420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.786295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.786420 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:42.786406 2579 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 18 11:27:42.786583 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:42.786487 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs podName:47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda nodeName:}" failed. No retries permitted until 2026-09-18 11:27:43.286462876 +0000 UTC m=+385.534367178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs") pod "kube-auth-proxy-5f6d56fbfb-z7p7k" (UID: "47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda") : secret "kube-auth-proxy-tls" not found Sep 18 11:27:42.788572 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.788550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tmp\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:42.811123 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:42.811098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllpj\" (UniqueName: \"kubernetes.io/projected/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-kube-api-access-nllpj\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:43.006208 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:43.006163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:43.290180 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:43.290144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:43.292737 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:43.292701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda-tls-certs\") pod \"kube-auth-proxy-5f6d56fbfb-z7p7k\" (UID: \"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda\") " pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:43.473272 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:43.473222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" Sep 18 11:27:43.751367 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:43.751332 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k"] Sep 18 11:27:43.754598 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:43.754567 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e0f261_ae6d_45f5_8e5b_6c4e2b28ceda.slice/crio-3ae6b79af484b60ce91ace0a27c13c7c9eaa1328b398df6a6e07de93b644b64e WatchSource:0}: Error finding container 3ae6b79af484b60ce91ace0a27c13c7c9eaa1328b398df6a6e07de93b644b64e: Status 404 returned error can't find the container with id 3ae6b79af484b60ce91ace0a27c13c7c9eaa1328b398df6a6e07de93b644b64e Sep 18 11:27:44.679573 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:44.679536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" event={"ID":"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda","Type":"ContainerStarted","Data":"3ae6b79af484b60ce91ace0a27c13c7c9eaa1328b398df6a6e07de93b644b64e"} Sep 18 11:27:45.234071 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:45.234037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:45.359607 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:45.359579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:46.691464 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:46.691426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" event={"ID":"47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda","Type":"ContainerStarted","Data":"0e50e4bc1ce6a0d0061a897de3f795b484cc2e03c3a390b83769ba507ffab28f"} Sep 18 11:27:46.715857 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:46.715800 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f6d56fbfb-z7p7k" podStartSLOduration=1.8680411590000001 podStartE2EDuration="4.715783168s" totalImagesPullingTime="2.847742009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:27:46.71007713 +0000 UTC m=+388.957981436" watchObservedRunningTime="2026-09-18 11:27:46.715783168 +0000 UTC m=+388.963687521" Sep 18 11:27:46.770096 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:46.770059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:50.309124 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:50.309087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:50.408541 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:50.408509 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:50.630574 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:50.630536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:50.797617 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:50.797581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:50.966292 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:50.966206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:52.942999 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.942940 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dkpbt"] Sep 18 11:27:52.946232 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.946210 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:52.948635 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.948612 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 18 11:27:52.948729 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.948624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gnxd8\"" Sep 18 11:27:52.959067 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.959045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dkpbt"] Sep 18 11:27:52.965870 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:52.965845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.052136 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.052103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.062333 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.062303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqn9c\" (UniqueName: \"kubernetes.io/projected/0e6fee1f-be8d-4215-86e3-eef5bd8816db-kube-api-access-hqn9c\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.062480 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.062360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.155205 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.155171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.163681 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.163660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqn9c\" (UniqueName: \"kubernetes.io/projected/0e6fee1f-be8d-4215-86e3-eef5bd8816db-kube-api-access-hqn9c\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.163787 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.163695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.163837 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:53.163802 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 18 11:27:53.163885 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:53.163859 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert podName:0e6fee1f-be8d-4215-86e3-eef5bd8816db nodeName:}" failed. No retries permitted until 2026-09-18 11:27:53.663842049 +0000 UTC m=+395.911746350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert") pod "odh-model-controller-7998c67dc4-dkpbt" (UID: "0e6fee1f-be8d-4215-86e3-eef5bd8816db") : secret "odh-model-controller-webhook-cert" not found Sep 18 11:27:53.178394 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.178372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqn9c\" (UniqueName: \"kubernetes.io/projected/0e6fee1f-be8d-4215-86e3-eef5bd8816db-kube-api-access-hqn9c\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.254971 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.254874 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.353724 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.353670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.668635 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.668603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.671027 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.671006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e6fee1f-be8d-4215-86e3-eef5bd8816db-cert\") pod \"odh-model-controller-7998c67dc4-dkpbt\" (UID: \"0e6fee1f-be8d-4215-86e3-eef5bd8816db\") " pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.686670 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.686629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:53.693916 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.693894 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvdtp"] Sep 18 11:27:53.696998 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.696974 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:53.700587 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.700563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 18 11:27:53.713744 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.713725 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvdtp"] Sep 18 11:27:53.769767 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.769739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthkj\" (UniqueName: \"kubernetes.io/projected/3463177d-135c-43ae-b4d0-2ef3839c7247-kube-api-access-xthkj\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:53.769876 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.769792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:53.855833 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.855801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:53.870938 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.870918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:53.871055 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.870968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthkj\" (UniqueName: \"kubernetes.io/projected/3463177d-135c-43ae-b4d0-2ef3839c7247-kube-api-access-xthkj\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:53.871117 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:53.871100 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 18 11:27:53.871192 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:27:53.871182 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs podName:3463177d-135c-43ae-b4d0-2ef3839c7247 nodeName:}" failed. No retries permitted until 2026-09-18 11:27:54.371161505 +0000 UTC m=+396.619065791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs") pod "model-serving-api-54d89bd5fc-kvdtp" (UID: "3463177d-135c-43ae-b4d0-2ef3839c7247") : secret "model-serving-api-tls" not found Sep 18 11:27:53.885203 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:53.885164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthkj\" (UniqueName: \"kubernetes.io/projected/3463177d-135c-43ae-b4d0-2ef3839c7247-kube-api-access-xthkj\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:54.136106 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.136081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dkpbt"] Sep 18 11:27:54.138370 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:54.138348 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6fee1f_be8d_4215_86e3_eef5bd8816db.slice/crio-9df8fe458ea3ab481f773c02f9eaecfaef6f710c1472ecd128b8286de258d8a9 WatchSource:0}: Error finding container 9df8fe458ea3ab481f773c02f9eaecfaef6f710c1472ecd128b8286de258d8a9: Status 404 returned error can't find the container with id 9df8fe458ea3ab481f773c02f9eaecfaef6f710c1472ecd128b8286de258d8a9 Sep 18 11:27:54.147468 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.147443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:54.374972 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.374939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:54.377466 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.377440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3463177d-135c-43ae-b4d0-2ef3839c7247-tls-certs\") pod \"model-serving-api-54d89bd5fc-kvdtp\" (UID: \"3463177d-135c-43ae-b4d0-2ef3839c7247\") " pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:54.607305 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.607219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:54.726958 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.726930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" event={"ID":"0e6fee1f-be8d-4215-86e3-eef5bd8816db","Type":"ContainerStarted","Data":"9df8fe458ea3ab481f773c02f9eaecfaef6f710c1472ecd128b8286de258d8a9"} Sep 18 11:27:54.895837 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:54.895800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-kvdtp"] Sep 18 11:27:54.899526 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:54.899496 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3463177d_135c_43ae_b4d0_2ef3839c7247.slice/crio-c40615e4690f15d77c75cf515ac3d474388f3f82c199d059c2b46035798e0f27 WatchSource:0}: Error finding container c40615e4690f15d77c75cf515ac3d474388f3f82c199d059c2b46035798e0f27: Status 404 returned error can't find the container with id c40615e4690f15d77c75cf515ac3d474388f3f82c199d059c2b46035798e0f27 Sep 18 11:27:55.734314 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:55.734279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" event={"ID":"3463177d-135c-43ae-b4d0-2ef3839c7247","Type":"ContainerStarted","Data":"c40615e4690f15d77c75cf515ac3d474388f3f82c199d059c2b46035798e0f27"} Sep 18 11:27:57.568475 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.568444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:57.669893 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.669800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:27:57.745555 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.745518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" event={"ID":"3463177d-135c-43ae-b4d0-2ef3839c7247","Type":"ContainerStarted","Data":"b6b167fb8bd3c094f1120d23b72b8299d84098e45d0255dbedd551cf086c2bc4"} Sep 18 11:27:57.745753 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.745649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:27:57.747490 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.747430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" event={"ID":"0e6fee1f-be8d-4215-86e3-eef5bd8816db","Type":"ContainerStarted","Data":"2245c72d590ed5e712dea207d02cf9bed3a77b9c37a03a0a8b19514114e2ad24"} Sep 18 11:27:57.747663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.747526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:27:57.768229 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.768155 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" podStartSLOduration=2.256657315 podStartE2EDuration="4.768136098s" totalImagesPullingTime="2.511478783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:27:57.766615888 +0000 UTC m=+400.014520193" watchObservedRunningTime="2026-09-18 11:27:57.768136098 +0000 UTC m=+400.016040405" Sep 18 11:27:57.796223 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:57.796175 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" podStartSLOduration=2.519908566 podStartE2EDuration="5.796159748s" totalImagesPullingTime="3.276251182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:27:57.795122057 +0000 UTC m=+400.043026376" watchObservedRunningTime="2026-09-18 11:27:57.796159748 +0000 UTC m=+400.044064061" Sep 18 11:27:58.532836 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.532803 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg"] Sep 18 11:27:58.536016 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.535978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.539914 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.539892 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 18 11:27:58.540060 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.539927 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 18 11:27:58.540916 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.540896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 18 11:27:58.541037 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.540901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k4klb\"" Sep 18 11:27:58.541037 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.540901 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 18 11:27:58.541037 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.540901 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 18 11:27:58.552023 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.551976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg"] Sep 18 11:27:58.610934 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.610893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5294a1f3-f8dd-409f-8c70-b977435bed18-manager-config\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.610934 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.610937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-metrics-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.611388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.610966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqb6m\" (UniqueName: \"kubernetes.io/projected/5294a1f3-f8dd-409f-8c70-b977435bed18-kube-api-access-sqb6m\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.611388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.611008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.712324 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.712285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqb6m\" (UniqueName: \"kubernetes.io/projected/5294a1f3-f8dd-409f-8c70-b977435bed18-kube-api-access-sqb6m\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.712470 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.712338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.712470 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.712398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5294a1f3-f8dd-409f-8c70-b977435bed18-manager-config\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.712470 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.712426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-metrics-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.713334 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.713312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5294a1f3-f8dd-409f-8c70-b977435bed18-manager-config\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.715004 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.714953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-metrics-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.715131 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.715113 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5294a1f3-f8dd-409f-8c70-b977435bed18-cert\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.721675 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.721648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqb6m\" (UniqueName: \"kubernetes.io/projected/5294a1f3-f8dd-409f-8c70-b977435bed18-kube-api-access-sqb6m\") pod \"lws-controller-manager-5c77776b6b-x98rg\" (UID: \"5294a1f3-f8dd-409f-8c70-b977435bed18\") " pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:58.845549 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:58.845469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:27:59.130204 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:59.130179 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg"] Sep 18 11:27:59.132346 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:27:59.132316 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5294a1f3_f8dd_409f_8c70_b977435bed18.slice/crio-3ef444404dd0dddc2729d3d8dc7d8bdc7fe5ad44a8e775790f0473cfa7e04158 WatchSource:0}: Error finding container 3ef444404dd0dddc2729d3d8dc7d8bdc7fe5ad44a8e775790f0473cfa7e04158: Status 404 returned error can't find the container with id 3ef444404dd0dddc2729d3d8dc7d8bdc7fe5ad44a8e775790f0473cfa7e04158 Sep 18 11:27:59.757648 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:27:59.757618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" event={"ID":"5294a1f3-f8dd-409f-8c70-b977435bed18","Type":"ContainerStarted","Data":"3ef444404dd0dddc2729d3d8dc7d8bdc7fe5ad44a8e775790f0473cfa7e04158"} Sep 18 11:28:04.544386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:04.544348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:04.662106 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:04.662079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:04.779216 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:04.779181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:05.162348 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:05.162317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:05.860042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:05.859973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:05.984228 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:05.984199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:06.139931 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:06.139898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:08.754083 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:08.754053 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dkpbt" Sep 18 11:28:08.755857 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:08.755831 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-kvdtp" Sep 18 11:28:16.838077 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:16.838039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" event={"ID":"5294a1f3-f8dd-409f-8c70-b977435bed18","Type":"ContainerStarted","Data":"cf954b478fcc7f71ef6c73bd2bfbad4e30f7d05c96d09485f1f8ee6f824daa31"} Sep 18 11:28:16.838521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:16.838166 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:28:16.859187 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:16.859140 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" podStartSLOduration=1.945326731 podStartE2EDuration="18.859125907s" totalImagesPullingTime="16.913799176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:28:16.857526097 +0000 UTC m=+419.105430409" watchObservedRunningTime="2026-09-18 11:28:16.859125907 +0000 UTC m=+419.107030218" Sep 18 11:28:27.845150 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:27.845119 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c77776b6b-x98rg" Sep 18 11:28:54.872219 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:54.872128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:28:54.960452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:28:54.960412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:11.354767 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:11.354730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:11.456629 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:11.456591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:12.107824 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:12.107793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:14.498350 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:14.498315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:14.938003 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:14.937937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:15.937071 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:15.937035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:16.044333 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:16.044301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.012617 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.012580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.355864 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.355786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.504808 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.504767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.611301 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.611218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.748184 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.748149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:18.859239 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:18.859204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:19.127795 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:19.127765 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:19.232484 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:19.232445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:22.511634 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:22.511601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:22.753387 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:22.753356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:25.555744 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:25.555709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:25.744495 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:25.744454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:29.771739 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:29.771688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:30.032394 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:30.032305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:30.888490 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:30.888459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:30.966119 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:30.966085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:31.108825 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:31.108787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:31.224225 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:31.224129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:34.996207 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:34.996156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:35.099778 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:35.099738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:35.195623 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:35.195580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:42.156470 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:42.156433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:42.287312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:42.287277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:44.802573 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:44.802530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:44.917779 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:44.917745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:50.071610 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:50.071569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:50.174740 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:50.174703 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:50.476480 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:50.476436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:50.578347 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:50.578311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:54.791046 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:54.791013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:54.897170 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:54.897139 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:29:54.992054 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:29:54.992017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:01.996233 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:01.996198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:02.094508 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:02.094464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:09.216241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:09.216197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:09.481140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:09.481031 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:14.951898 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:14.951861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:15.031194 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:15.031149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:23.022117 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.022078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:23.133011 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.132949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:23.209860 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.209823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:23.871521 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.871488 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:23.874718 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.874701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:23.877427 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.877405 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6pfd7\"" Sep 18 11:30:23.877427 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.877409 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 18 11:30:23.878206 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.878175 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 18 11:30:23.885930 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.885908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:23.902640 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.902602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wclw7\" (UniqueName: \"kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7\") pod \"authorino-7bcfd8f9cd-hns74\" (UID: \"57b89237-ba33-40cd-94d5-825e7bbd9483\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:23.916681 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:23.916647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:24.003881 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.003838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wclw7\" (UniqueName: \"kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7\") pod \"authorino-7bcfd8f9cd-hns74\" (UID: \"57b89237-ba33-40cd-94d5-825e7bbd9483\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:24.013470 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.013442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wclw7\" (UniqueName: \"kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7\") pod \"authorino-7bcfd8f9cd-hns74\" (UID: \"57b89237-ba33-40cd-94d5-825e7bbd9483\") " pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:24.016947 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.016922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:24.083979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.083942 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:30:24.087089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.087072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:30:24.098612 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.098576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:30:24.183706 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.183677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:24.206008 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.205917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jmp\" (UniqueName: \"kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp\") pod \"authorino-59c974bd48-wdt42\" (UID: \"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3\") " pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:30:24.306555 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.306519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jmp\" (UniqueName: \"kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp\") pod \"authorino-59c974bd48-wdt42\" (UID: \"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3\") " pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:30:24.316508 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.316463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jmp\" (UniqueName: \"kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp\") pod \"authorino-59c974bd48-wdt42\" (UID: \"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3\") " pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:30:24.396505 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.396470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:30:24.458441 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.458410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:24.459876 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:30:24.459834 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57b89237_ba33_40cd_94d5_825e7bbd9483.slice/crio-2f34bcbcef0b94c3d2989c8fd931b61102b8d7184766af49e979184e8473e4c4 WatchSource:0}: Error finding container 2f34bcbcef0b94c3d2989c8fd931b61102b8d7184766af49e979184e8473e4c4: Status 404 returned error can't find the container with id 2f34bcbcef0b94c3d2989c8fd931b61102b8d7184766af49e979184e8473e4c4 Sep 18 11:30:24.667854 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:24.667821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:30:24.671196 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:30:24.671168 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2f4feb0_9f14_4f4f_9961_fb6dab6c16a3.slice/crio-ca21c13e8c6fbbe1d97eee6379ba6e11c49f823805f1dd530504a7687e91279a WatchSource:0}: Error finding container ca21c13e8c6fbbe1d97eee6379ba6e11c49f823805f1dd530504a7687e91279a: Status 404 returned error can't find the container with id ca21c13e8c6fbbe1d97eee6379ba6e11c49f823805f1dd530504a7687e91279a Sep 18 11:30:25.376396 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:25.376362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wdt42" event={"ID":"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3","Type":"ContainerStarted","Data":"ca21c13e8c6fbbe1d97eee6379ba6e11c49f823805f1dd530504a7687e91279a"} Sep 18 11:30:25.377729 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:25.377701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" event={"ID":"57b89237-ba33-40cd-94d5-825e7bbd9483","Type":"ContainerStarted","Data":"2f34bcbcef0b94c3d2989c8fd931b61102b8d7184766af49e979184e8473e4c4"} Sep 18 11:30:28.396718 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:28.396675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wdt42" event={"ID":"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3","Type":"ContainerStarted","Data":"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f"} Sep 18 11:30:28.398276 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:28.398251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" event={"ID":"57b89237-ba33-40cd-94d5-825e7bbd9483","Type":"ContainerStarted","Data":"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955"} Sep 18 11:30:28.416512 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:28.416460 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-wdt42" podStartSLOduration=1.414077893 podStartE2EDuration="4.416443075s" totalImagesPullingTime="3.002365182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:30:28.41502818 +0000 UTC m=+550.662932481" watchObservedRunningTime="2026-09-18 11:30:28.416443075 +0000 UTC m=+550.664347376" Sep 18 11:30:28.441338 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:28.441276 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" podStartSLOduration=2.237174829 podStartE2EDuration="5.441252896s" totalImagesPullingTime="3.204078067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:30:28.440125929 +0000 UTC m=+550.688030235" watchObservedRunningTime="2026-09-18 11:30:28.441252896 +0000 UTC m=+550.689157205" Sep 18 11:30:28.481209 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:28.481160 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:30.406606 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:30.406561 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" podUID="57b89237-ba33-40cd-94d5-825e7bbd9483" containerName="authorino" containerID="cri-o://673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955" gracePeriod=30 Sep 18 11:30:30.651461 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:30.651438 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:30.756210 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:30.756136 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wclw7\" (UniqueName: \"kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7\") pod \"57b89237-ba33-40cd-94d5-825e7bbd9483\" (UID: \"57b89237-ba33-40cd-94d5-825e7bbd9483\") " Sep 18 11:30:30.758365 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:30.758336 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7" (OuterVolumeSpecName: "kube-api-access-wclw7") pod "57b89237-ba33-40cd-94d5-825e7bbd9483" (UID: "57b89237-ba33-40cd-94d5-825e7bbd9483"). InnerVolumeSpecName "kube-api-access-wclw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:30:30.857255 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:30.857228 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wclw7\" (UniqueName: \"kubernetes.io/projected/57b89237-ba33-40cd-94d5-825e7bbd9483-kube-api-access-wclw7\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:30:31.411580 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.411549 2579 generic.go:356] "Generic (PLEG): container finished" podID="57b89237-ba33-40cd-94d5-825e7bbd9483" containerID="673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955" exitCode=0 Sep 18 11:30:31.411976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.411590 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" Sep 18 11:30:31.411976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.411646 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" event={"ID":"57b89237-ba33-40cd-94d5-825e7bbd9483","Type":"ContainerDied","Data":"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955"} Sep 18 11:30:31.411976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.411684 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-hns74" event={"ID":"57b89237-ba33-40cd-94d5-825e7bbd9483","Type":"ContainerDied","Data":"2f34bcbcef0b94c3d2989c8fd931b61102b8d7184766af49e979184e8473e4c4"} Sep 18 11:30:31.411976 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.411700 2579 scope.go:117] "RemoveContainer" containerID="673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955" Sep 18 11:30:31.420457 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.420440 2579 scope.go:117] "RemoveContainer" containerID="673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955" Sep 18 11:30:31.420761 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:30:31.420740 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955\": container with ID starting with 673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955 not found: ID does not exist" containerID="673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955" Sep 18 11:30:31.420806 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.420774 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955"} err="failed to get container status \"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955\": rpc error: code = NotFound desc = could not find container \"673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955\": container with ID starting with 673d26b57eb8b51206d2257c838854c5740617db62148835cedaac31f0cd2955 not found: ID does not exist" Sep 18 11:30:31.435625 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.435588 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:31.440808 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:31.440779 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-hns74"] Sep 18 11:30:32.249056 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:32.249020 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b89237-ba33-40cd-94d5-825e7bbd9483" path="/var/lib/kubelet/pods/57b89237-ba33-40cd-94d5-825e7bbd9483/volumes" Sep 18 11:30:48.480420 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:48.480366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:48.580590 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:48.580550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:53.459464 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:53.459409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:53.552835 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:53.552802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:30:53.900529 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:30:53.900493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:06.450455 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.450412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:06.671423 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.671394 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-vzwsn"] Sep 18 11:31:06.671675 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.671662 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b89237-ba33-40cd-94d5-825e7bbd9483" containerName="authorino" Sep 18 11:31:06.671723 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.671677 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b89237-ba33-40cd-94d5-825e7bbd9483" containerName="authorino" Sep 18 11:31:06.671757 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.671733 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b89237-ba33-40cd-94d5-825e7bbd9483" containerName="authorino" Sep 18 11:31:06.675768 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.675750 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:06.700697 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.700604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-vzwsn"] Sep 18 11:31:06.730384 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.730336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:06.752636 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.752612 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-vzwsn"] Sep 18 11:31:06.752854 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:31:06.752834 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qwfvd], unattached volumes=[], failed to process volumes=[kube-api-access-qwfvd]: context canceled" pod="kuadrant-system/authorino-557f876f69-vzwsn" podUID="8ca14316-586a-4d25-8b22-e47baf8145c9" Sep 18 11:31:06.787370 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.787348 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hfrmd"] Sep 18 11:31:06.789647 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.789632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:06.792108 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.792093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 18 11:31:06.815452 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.815414 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hfrmd"] Sep 18 11:31:06.841622 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.841596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfvd\" (UniqueName: \"kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd\") pod \"authorino-557f876f69-vzwsn\" (UID: \"8ca14316-586a-4d25-8b22-e47baf8145c9\") " pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:06.911846 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.911817 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hfrmd"] Sep 18 11:31:06.912113 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:31:06.912092 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jnpg2 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" podUID="0c393efa-7827-4704-8d90-197b38cf86cc" Sep 18 11:31:06.941944 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.941915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfvd\" (UniqueName: \"kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd\") pod \"authorino-557f876f69-vzwsn\" (UID: \"8ca14316-586a-4d25-8b22-e47baf8145c9\") " pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:06.942140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.941962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:06.942140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.942022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpg2\" (UniqueName: \"kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:06.950563 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.950540 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:31:06.952865 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.952824 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:06.963558 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.963535 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfvd\" (UniqueName: \"kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd\") pod \"authorino-557f876f69-vzwsn\" (UID: \"8ca14316-586a-4d25-8b22-e47baf8145c9\") " pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:06.964344 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:06.964323 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:31:07.043252 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.043222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.043435 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.043259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgft\" (UniqueName: \"kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.043435 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.043280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpg2\" (UniqueName: \"kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.043435 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.043399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.045780 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.045761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.051141 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.051121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpg2\" (UniqueName: \"kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2\") pod \"authorino-6d4dfc649f-hfrmd\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.144288 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.144256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.144469 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.144310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgft\" (UniqueName: \"kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.146808 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.146787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.156338 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.156314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgft\" (UniqueName: \"kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft\") pod \"authorino-f498b9dbb-prtns\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.261714 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.261629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:31:07.534032 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.533926 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:31:07.536641 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:31:07.536607 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51ffc592_0976_453f_8c05_559e89e53f59.slice/crio-16342b3f246305ccc580318a0f48e87a2a5a32dac669c10a3aaef7230cc1ac19 WatchSource:0}: Error finding container 16342b3f246305ccc580318a0f48e87a2a5a32dac669c10a3aaef7230cc1ac19: Status 404 returned error can't find the container with id 16342b3f246305ccc580318a0f48e87a2a5a32dac669c10a3aaef7230cc1ac19 Sep 18 11:31:07.571856 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.571827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.571856 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.571851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f498b9dbb-prtns" event={"ID":"51ffc592-0976-453f-8c05-559e89e53f59","Type":"ContainerStarted","Data":"16342b3f246305ccc580318a0f48e87a2a5a32dac669c10a3aaef7230cc1ac19"} Sep 18 11:31:07.572111 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.571954 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:07.578582 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.578561 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:07.580894 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.580878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:07.749308 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.749263 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert\") pod \"0c393efa-7827-4704-8d90-197b38cf86cc\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " Sep 18 11:31:07.749490 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.749375 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwfvd\" (UniqueName: \"kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd\") pod \"8ca14316-586a-4d25-8b22-e47baf8145c9\" (UID: \"8ca14316-586a-4d25-8b22-e47baf8145c9\") " Sep 18 11:31:07.749490 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.749414 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnpg2\" (UniqueName: \"kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2\") pod \"0c393efa-7827-4704-8d90-197b38cf86cc\" (UID: \"0c393efa-7827-4704-8d90-197b38cf86cc\") " Sep 18 11:31:07.751612 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.751583 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0c393efa-7827-4704-8d90-197b38cf86cc" (UID: "0c393efa-7827-4704-8d90-197b38cf86cc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 11:31:07.751729 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.751630 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd" (OuterVolumeSpecName: "kube-api-access-qwfvd") pod "8ca14316-586a-4d25-8b22-e47baf8145c9" (UID: "8ca14316-586a-4d25-8b22-e47baf8145c9"). InnerVolumeSpecName "kube-api-access-qwfvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:31:07.751729 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.751626 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2" (OuterVolumeSpecName: "kube-api-access-jnpg2") pod "0c393efa-7827-4704-8d90-197b38cf86cc" (UID: "0c393efa-7827-4704-8d90-197b38cf86cc"). InnerVolumeSpecName "kube-api-access-jnpg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:31:07.850200 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.850112 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c393efa-7827-4704-8d90-197b38cf86cc-tls-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:31:07.850200 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.850142 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfvd\" (UniqueName: \"kubernetes.io/projected/8ca14316-586a-4d25-8b22-e47baf8145c9-kube-api-access-qwfvd\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:31:07.850200 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:07.850155 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnpg2\" (UniqueName: \"kubernetes.io/projected/0c393efa-7827-4704-8d90-197b38cf86cc-kube-api-access-jnpg2\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:31:08.577878 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.577778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f498b9dbb-prtns" event={"ID":"51ffc592-0976-453f-8c05-559e89e53f59","Type":"ContainerStarted","Data":"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b"} Sep 18 11:31:08.577878 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.577796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-hfrmd" Sep 18 11:31:08.578378 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.577955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-vzwsn" Sep 18 11:31:08.599510 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.599455 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f498b9dbb-prtns" podStartSLOduration=1.771042563 podStartE2EDuration="2.599437374s" totalImagesPullingTime="828.394811ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:31:08.597739833 +0000 UTC m=+590.845644139" watchObservedRunningTime="2026-09-18 11:31:08.599437374 +0000 UTC m=+590.847341681" Sep 18 11:31:08.629100 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.629066 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:31:08.629287 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.629264 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-wdt42" podUID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" containerName="authorino" containerID="cri-o://5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f" gracePeriod=30 Sep 18 11:31:08.632538 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.632499 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-vzwsn"] Sep 18 11:31:08.647523 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.647496 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-vzwsn"] Sep 18 11:31:08.675617 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.675585 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hfrmd"] Sep 18 11:31:08.677749 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.677723 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-hfrmd"] Sep 18 11:31:08.871235 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.871214 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:31:08.958654 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.958613 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jmp\" (UniqueName: \"kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp\") pod \"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3\" (UID: \"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3\") " Sep 18 11:31:08.960794 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:08.960761 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp" (OuterVolumeSpecName: "kube-api-access-q7jmp") pod "f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" (UID: "f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3"). InnerVolumeSpecName "kube-api-access-q7jmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:31:09.059396 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.059361 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jmp\" (UniqueName: \"kubernetes.io/projected/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3-kube-api-access-q7jmp\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:31:09.583705 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.583666 2579 generic.go:356] "Generic (PLEG): container finished" podID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" containerID="5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f" exitCode=0 Sep 18 11:31:09.583705 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.583705 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-wdt42" Sep 18 11:31:09.584195 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.583748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wdt42" event={"ID":"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3","Type":"ContainerDied","Data":"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f"} Sep 18 11:31:09.584195 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.583787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-wdt42" event={"ID":"f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3","Type":"ContainerDied","Data":"ca21c13e8c6fbbe1d97eee6379ba6e11c49f823805f1dd530504a7687e91279a"} Sep 18 11:31:09.584195 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.583804 2579 scope.go:117] "RemoveContainer" containerID="5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f" Sep 18 11:31:09.592713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.592697 2579 scope.go:117] "RemoveContainer" containerID="5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f" Sep 18 11:31:09.593048 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:31:09.593026 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f\": container with ID starting with 5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f not found: ID does not exist" containerID="5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f" Sep 18 11:31:09.593097 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.593064 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f"} err="failed to get container status \"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f\": rpc error: code = NotFound desc = could not find container \"5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f\": container with ID starting with 5d96fce8874547bc85757f1999d513d8c3bbb638b601884365dc68356c9d9c8f not found: ID does not exist" Sep 18 11:31:09.614963 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.614933 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:31:09.618951 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:09.618932 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-wdt42"] Sep 18 11:31:10.248595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:10.248560 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c393efa-7827-4704-8d90-197b38cf86cc" path="/var/lib/kubelet/pods/0c393efa-7827-4704-8d90-197b38cf86cc/volumes" Sep 18 11:31:10.248791 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:10.248779 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca14316-586a-4d25-8b22-e47baf8145c9" path="/var/lib/kubelet/pods/8ca14316-586a-4d25-8b22-e47baf8145c9/volumes" Sep 18 11:31:10.248964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:10.248953 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" path="/var/lib/kubelet/pods/f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3/volumes" Sep 18 11:31:13.314643 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:13.314610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:13.418375 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:13.418338 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:13.515906 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:13.515872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:13.672271 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:13.672235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:17.000781 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:17.000741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:17.103948 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:17.103919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:18.663200 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:18.663082 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:31:18.669752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:18.663833 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:31:35.806492 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:35.806456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:37.595730 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:37.595687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:42.632043 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:42.631933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:49.669007 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:49.668935 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:49.768237 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:49.768204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.274588 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.274553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.373202 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.373160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.537726 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.537633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.741599 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.741565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.877316 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.877276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:51.973706 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:51.973663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:31:52.089448 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.089411 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:31:52.089827 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.089810 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" containerName="authorino" Sep 18 11:31:52.089870 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.089832 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" containerName="authorino" Sep 18 11:31:52.089932 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.089921 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f4feb0-9f14-4f4f-9961-fb6dab6c16a3" containerName="authorino" Sep 18 11:31:52.092958 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.092932 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.095890 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.095857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-78ghl\"" Sep 18 11:31:52.096035 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.095862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 18 11:31:52.112794 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.112766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:31:52.197126 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.196935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftrt\" (UniqueName: \"kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.197460 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.197439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.298638 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.298603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftrt\" (UniqueName: \"kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.299030 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.298650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.299343 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.299325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.308119 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.308089 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftrt\" (UniqueName: \"kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt\") pod \"payload-pre-processing-59fbc47bf8-9whgt\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.403256 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.403215 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:52.702877 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.702846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:31:52.704290 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:31:52.704265 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c48dac_4492_4498_b76d_6f5f90cf9d08.slice/crio-12c5242472b82528de79192b03248f244b8db079b0a2d570ce43eef3eef5428f WatchSource:0}: Error finding container 12c5242472b82528de79192b03248f244b8db079b0a2d570ce43eef3eef5428f: Status 404 returned error can't find the container with id 12c5242472b82528de79192b03248f244b8db079b0a2d570ce43eef3eef5428f Sep 18 11:31:52.706663 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.706643 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 11:31:52.770261 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:52.770227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" event={"ID":"a1c48dac-4492-4498-b76d-6f5f90cf9d08","Type":"ContainerStarted","Data":"12c5242472b82528de79192b03248f244b8db079b0a2d570ce43eef3eef5428f"} Sep 18 11:31:54.782841 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:54.782803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" event={"ID":"a1c48dac-4492-4498-b76d-6f5f90cf9d08","Type":"ContainerStarted","Data":"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14"} Sep 18 11:31:54.783243 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:54.782934 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:31:54.808902 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:31:54.808852 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" podStartSLOduration=1.556009591 podStartE2EDuration="2.808835045s" totalImagesPullingTime="1.252825454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:31:54.807489867 +0000 UTC m=+637.055394175" watchObservedRunningTime="2026-09-18 11:31:54.808835045 +0000 UTC m=+637.056739352" Sep 18 11:32:02.405176 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:02.405141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:02.506350 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:02.506315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:05.790668 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:05.790640 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:32:19.156669 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:19.156634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:39.846241 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:39.846212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:45.906773 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.906737 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47"] Sep 18 11:32:45.909798 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.909783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:45.912315 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.912290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5chvz\"" Sep 18 11:32:45.912315 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.912304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 18 11:32:45.913465 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.913447 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 18 11:32:45.913551 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.913514 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 18 11:32:45.921889 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:45.921869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47"] Sep 18 11:32:46.002580 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.002525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:46.014695 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqjm\" (UniqueName: \"kubernetes.io/projected/e11f7e61-342b-4419-8d4f-bf5dac010106-kube-api-access-6zqjm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.014837 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.014837 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.014837 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.014979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.014979 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.014873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e11f7e61-342b-4419-8d4f-bf5dac010106-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115424 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e11f7e61-342b-4419-8d4f-bf5dac010106-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115605 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqjm\" (UniqueName: \"kubernetes.io/projected/e11f7e61-342b-4419-8d4f-bf5dac010106-kube-api-access-6zqjm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115872 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115848 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115927 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115868 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.115973 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.115947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.117929 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.117905 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e11f7e61-342b-4419-8d4f-bf5dac010106-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.118187 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.118170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e11f7e61-342b-4419-8d4f-bf5dac010106-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.124906 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.124881 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqjm\" (UniqueName: \"kubernetes.io/projected/e11f7e61-342b-4419-8d4f-bf5dac010106-kube-api-access-6zqjm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47\" (UID: \"e11f7e61-342b-4419-8d4f-bf5dac010106\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.219532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.219444 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:46.493739 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:46.493672 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47"] Sep 18 11:32:46.497063 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:32:46.497037 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11f7e61_342b_4419_8d4f_bf5dac010106.slice/crio-8dbf225379e129f0b0517234de704f4e585db49434f66101454663757c983f38 WatchSource:0}: Error finding container 8dbf225379e129f0b0517234de704f4e585db49434f66101454663757c983f38: Status 404 returned error can't find the container with id 8dbf225379e129f0b0517234de704f4e585db49434f66101454663757c983f38 Sep 18 11:32:47.004959 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:47.004895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" event={"ID":"e11f7e61-342b-4419-8d4f-bf5dac010106","Type":"ContainerStarted","Data":"8dbf225379e129f0b0517234de704f4e585db49434f66101454663757c983f38"} Sep 18 11:32:48.012140 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:48.012102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" event={"ID":"e11f7e61-342b-4419-8d4f-bf5dac010106","Type":"ContainerStarted","Data":"8e7a0600e3839b9b51678cde69ed489da681ced7cbc1e6eda1bf413e16e98b7d"} Sep 18 11:32:48.044303 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:48.044250 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" podStartSLOduration=1.9657540949999999 podStartE2EDuration="3.044232682s" totalImagesPullingTime="1.078478587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:32:48.043919181 +0000 UTC m=+690.291823487" watchObservedRunningTime="2026-09-18 11:32:48.044232682 +0000 UTC m=+690.292137008" Sep 18 11:32:53.835042 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.834981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64"] Sep 18 11:32:53.838296 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.838280 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.847141 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.847119 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 18 11:32:53.884440 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnfd\" (UniqueName: \"kubernetes.io/projected/c3385a29-79ff-467e-bf50-41263186396c-kube-api-access-hrnfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.884639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.884639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3385a29-79ff-467e-bf50-41263186396c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.884639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.884639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.884639 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.884600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.890118 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.890087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64"] Sep 18 11:32:53.945217 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.945180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:32:53.985516 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.985689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnfd\" (UniqueName: \"kubernetes.io/projected/c3385a29-79ff-467e-bf50-41263186396c-kube-api-access-hrnfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.985689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.985689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3385a29-79ff-467e-bf50-41263186396c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.985689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.985689 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.985638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.986030 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.986013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.986107 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.986042 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.986158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.986129 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.988195 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.988167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3385a29-79ff-467e-bf50-41263186396c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:53.988477 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:53.988459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3385a29-79ff-467e-bf50-41263186396c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:54.009272 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:54.009235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnfd\" (UniqueName: \"kubernetes.io/projected/c3385a29-79ff-467e-bf50-41263186396c-kube-api-access-hrnfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vdd64\" (UID: \"c3385a29-79ff-467e-bf50-41263186396c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:54.148698 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:54.148659 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:32:54.424212 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:54.424133 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64"] Sep 18 11:32:54.428157 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:32:54.428134 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3385a29_79ff_467e_bf50_41263186396c.slice/crio-5cd91e54456ccf8f18f579777a8b28886939e309912a00dfd786cd54a67dd129 WatchSource:0}: Error finding container 5cd91e54456ccf8f18f579777a8b28886939e309912a00dfd786cd54a67dd129: Status 404 returned error can't find the container with id 5cd91e54456ccf8f18f579777a8b28886939e309912a00dfd786cd54a67dd129 Sep 18 11:32:55.045188 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:55.045154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" event={"ID":"c3385a29-79ff-467e-bf50-41263186396c","Type":"ContainerStarted","Data":"00c8cfb0302842e548b69548218425c2fc9839ed099afcf1bdf64255d320bba6"} Sep 18 11:32:55.045666 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:55.045215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" event={"ID":"c3385a29-79ff-467e-bf50-41263186396c","Type":"ContainerStarted","Data":"5cd91e54456ccf8f18f579777a8b28886939e309912a00dfd786cd54a67dd129"} Sep 18 11:32:55.071007 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:55.068070 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" podStartSLOduration=1.890757654 podStartE2EDuration="2.068046788s" totalImagesPullingTime="177.289134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:32:55.065683667 +0000 UTC m=+697.313587988" watchObservedRunningTime="2026-09-18 11:32:55.068046788 +0000 UTC m=+697.315951096" Sep 18 11:32:56.220626 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:56.220585 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:56.221025 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:56.220658 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:56.233324 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:56.233297 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:32:57.065409 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:32:57.065377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-g5t47" Sep 18 11:33:04.149822 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:04.149788 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:33:04.150223 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:04.149844 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:33:04.162126 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:04.162101 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:33:05.101674 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:05.101647 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vdd64" Sep 18 11:33:11.208355 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.208284 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4"] Sep 18 11:33:11.211549 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.211532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.214233 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.214210 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 18 11:33:11.224804 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.224782 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4"] Sep 18 11:33:11.244972 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.244942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:33:11.337774 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.337964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.337964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqmk\" (UniqueName: \"kubernetes.io/projected/73189249-16d9-4efe-9515-3f1df1ac9c12-kube-api-access-ckqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.337964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.337964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73189249-16d9-4efe-9515-3f1df1ac9c12-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.337964 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.337917 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439134 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqmk\" (UniqueName: \"kubernetes.io/projected/73189249-16d9-4efe-9515-3f1df1ac9c12-kube-api-access-ckqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439289 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439289 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73189249-16d9-4efe-9515-3f1df1ac9c12-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439289 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439289 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439498 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439604 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439682 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.439682 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.439638 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.441576 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.441557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73189249-16d9-4efe-9515-3f1df1ac9c12-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.441843 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.441824 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73189249-16d9-4efe-9515-3f1df1ac9c12-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.453574 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.453547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqmk\" (UniqueName: \"kubernetes.io/projected/73189249-16d9-4efe-9515-3f1df1ac9c12-kube-api-access-ckqmk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4\" (UID: \"73189249-16d9-4efe-9515-3f1df1ac9c12\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.521201 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.521130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:11.801504 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:11.801337 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4"] Sep 18 11:33:11.804025 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:33:11.803999 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73189249_16d9_4efe_9515_3f1df1ac9c12.slice/crio-b6d657053020ee8193d63b7431eebb25732a6a5454bd0edfb085487e11a1c384 WatchSource:0}: Error finding container b6d657053020ee8193d63b7431eebb25732a6a5454bd0edfb085487e11a1c384: Status 404 returned error can't find the container with id b6d657053020ee8193d63b7431eebb25732a6a5454bd0edfb085487e11a1c384 Sep 18 11:33:12.121493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:12.121415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" event={"ID":"73189249-16d9-4efe-9515-3f1df1ac9c12","Type":"ContainerStarted","Data":"9490b9e6d0273b200527129b0a9a7047020385d2c803264dd8c5580c2fd96f25"} Sep 18 11:33:12.121493 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:12.121474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" event={"ID":"73189249-16d9-4efe-9515-3f1df1ac9c12","Type":"ContainerStarted","Data":"b6d657053020ee8193d63b7431eebb25732a6a5454bd0edfb085487e11a1c384"} Sep 18 11:33:12.147255 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:12.147209 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" podStartSLOduration=0.976555292 podStartE2EDuration="1.147193227s" totalImagesPullingTime="170.637935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:33:12.146420863 +0000 UTC m=+714.394325193" watchObservedRunningTime="2026-09-18 11:33:12.147193227 +0000 UTC m=+714.395097534" Sep 18 11:33:17.067626 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.067587 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln"] Sep 18 11:33:17.070812 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.070790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.077700 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.077678 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 18 11:33:17.102732 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.102702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln"] Sep 18 11:33:17.188960 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.188929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.189142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.188967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.189142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.189009 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.189142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.189078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264c8036-c37c-4fae-93fa-cec3ce384598-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.189142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.189115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.189142 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.189131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrlz8\" (UniqueName: \"kubernetes.io/projected/264c8036-c37c-4fae-93fa-cec3ce384598-kube-api-access-mrlz8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.217354 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.217321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:33:17.289887 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.289851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.289887 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.289883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrlz8\" (UniqueName: \"kubernetes.io/projected/264c8036-c37c-4fae-93fa-cec3ce384598-kube-api-access-mrlz8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290308 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264c8036-c37c-4fae-93fa-cec3ce384598-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290308 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290279 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290412 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.290412 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.290403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.292497 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.292472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264c8036-c37c-4fae-93fa-cec3ce384598-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.292687 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.292672 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264c8036-c37c-4fae-93fa-cec3ce384598-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.302350 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.302320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrlz8\" (UniqueName: \"kubernetes.io/projected/264c8036-c37c-4fae-93fa-cec3ce384598-kube-api-access-mrlz8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v6sln\" (UID: \"264c8036-c37c-4fae-93fa-cec3ce384598\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.380510 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.380479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:17.666573 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:17.666537 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln"] Sep 18 11:33:17.667832 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:33:17.667790 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264c8036_c37c_4fae_93fa_cec3ce384598.slice/crio-8518a681a36340e8250601a8c50d8c74e62a57805de99bb05a3412761d82e3e0 WatchSource:0}: Error finding container 8518a681a36340e8250601a8c50d8c74e62a57805de99bb05a3412761d82e3e0: Status 404 returned error can't find the container with id 8518a681a36340e8250601a8c50d8c74e62a57805de99bb05a3412761d82e3e0 Sep 18 11:33:18.154020 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:18.153969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" event={"ID":"264c8036-c37c-4fae-93fa-cec3ce384598","Type":"ContainerStarted","Data":"7c93190464b4fc2bfaa95f60e5b8be0b05dd5c9889addf6ba999e2e9b2bde798"} Sep 18 11:33:18.154352 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:18.154051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" event={"ID":"264c8036-c37c-4fae-93fa-cec3ce384598","Type":"ContainerStarted","Data":"8518a681a36340e8250601a8c50d8c74e62a57805de99bb05a3412761d82e3e0"} Sep 18 11:33:18.175614 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:18.175569 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" podStartSLOduration=0.995417796 podStartE2EDuration="1.175553838s" totalImagesPullingTime="180.136042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:33:18.17312854 +0000 UTC m=+720.421032845" watchObservedRunningTime="2026-09-18 11:33:18.175553838 +0000 UTC m=+720.423458196" Sep 18 11:33:21.521505 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:21.521451 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:21.521892 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:21.521561 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:21.534326 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:21.534294 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:22.184958 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:22.184929 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fq69q4" Sep 18 11:33:27.380692 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:27.380659 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:27.381082 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:27.380747 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:27.392724 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:27.392701 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:28.212713 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:28.212685 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v6sln" Sep 18 11:33:39.920146 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.920109 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4"] Sep 18 11:33:39.925021 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.924979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.927568 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.927548 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 18 11:33:39.933742 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.933722 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4"] Sep 18 11:33:39.973370 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.973370 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.973595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.973595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904acc45-6c8d-4871-9af6-915748af3105-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.973595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkq57\" (UniqueName: \"kubernetes.io/projected/904acc45-6c8d-4871-9af6-915748af3105-kube-api-access-zkq57\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:39.973595 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:39.973528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.022827 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.022791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:33:40.074206 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904acc45-6c8d-4871-9af6-915748af3105-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074388 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkq57\" (UniqueName: \"kubernetes.io/projected/904acc45-6c8d-4871-9af6-915748af3105-kube-api-access-zkq57\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074712 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074712 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.074853 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.074729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.076618 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.076598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/904acc45-6c8d-4871-9af6-915748af3105-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.076847 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.076831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/904acc45-6c8d-4871-9af6-915748af3105-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.082666 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.082644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkq57\" (UniqueName: \"kubernetes.io/projected/904acc45-6c8d-4871-9af6-915748af3105-kube-api-access-zkq57\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-787g4\" (UID: \"904acc45-6c8d-4871-9af6-915748af3105\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.234923 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.234833 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:40.510337 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:40.510315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4"] Sep 18 11:33:40.512543 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:33:40.512514 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod904acc45_6c8d_4871_9af6_915748af3105.slice/crio-e07c631fb37fbcc52abe55eab863b7c6f4a89ee6ae25f12e77a879d0a1cd4c88 WatchSource:0}: Error finding container e07c631fb37fbcc52abe55eab863b7c6f4a89ee6ae25f12e77a879d0a1cd4c88: Status 404 returned error can't find the container with id e07c631fb37fbcc52abe55eab863b7c6f4a89ee6ae25f12e77a879d0a1cd4c88 Sep 18 11:33:41.261151 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:41.261114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" event={"ID":"904acc45-6c8d-4871-9af6-915748af3105","Type":"ContainerStarted","Data":"9322d387a958856b2e362e70624ca4a86a38d6fa4eaf626b505142988655cae0"} Sep 18 11:33:41.261548 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:41.261162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" event={"ID":"904acc45-6c8d-4871-9af6-915748af3105","Type":"ContainerStarted","Data":"e07c631fb37fbcc52abe55eab863b7c6f4a89ee6ae25f12e77a879d0a1cd4c88"} Sep 18 11:33:50.235069 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.235026 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:50.235069 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.235079 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:50.253275 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.253248 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:50.275601 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.275540 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" podStartSLOduration=11.105283294 podStartE2EDuration="11.2755238s" totalImagesPullingTime="170.240506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:33:41.296933025 +0000 UTC m=+743.544837333" watchObservedRunningTime="2026-09-18 11:33:50.2755238 +0000 UTC m=+752.523428107" Sep 18 11:33:50.311912 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.311874 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-787g4" Sep 18 11:33:50.645883 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:33:50.645851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:09.271566 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:09.271529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:11.439033 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:11.438979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:11.537784 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:11.537755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:31.198585 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.198551 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fd687d7f9-726wb"] Sep 18 11:34:31.202000 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.201965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.219593 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.219559 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd687d7f9-726wb"] Sep 18 11:34:31.305309 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.305271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-tls-cert\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.305485 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.305331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tllm\" (UniqueName: \"kubernetes.io/projected/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-kube-api-access-2tllm\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.406158 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.406128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-tls-cert\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.406266 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.406173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tllm\" (UniqueName: \"kubernetes.io/projected/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-kube-api-access-2tllm\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.408745 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.408713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-tls-cert\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.415604 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.415580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tllm\" (UniqueName: \"kubernetes.io/projected/c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb-kube-api-access-2tllm\") pod \"authorino-fd687d7f9-726wb\" (UID: \"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb\") " pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.510183 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.510096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd687d7f9-726wb" Sep 18 11:34:31.793437 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:31.793405 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd687d7f9-726wb"] Sep 18 11:34:31.793708 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:34:31.793686 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8240edf_bf8e_4bb0_8e07_a8bf9d443fbb.slice/crio-b1e66513c57ee4468d74b227be44a0fa41e3633d902c4734ef0805911ddbe55e WatchSource:0}: Error finding container b1e66513c57ee4468d74b227be44a0fa41e3633d902c4734ef0805911ddbe55e: Status 404 returned error can't find the container with id b1e66513c57ee4468d74b227be44a0fa41e3633d902c4734ef0805911ddbe55e Sep 18 11:34:32.485518 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:32.485479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd687d7f9-726wb" event={"ID":"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb","Type":"ContainerStarted","Data":"b1e66513c57ee4468d74b227be44a0fa41e3633d902c4734ef0805911ddbe55e"} Sep 18 11:34:33.494337 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.494298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd687d7f9-726wb" event={"ID":"c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb","Type":"ContainerStarted","Data":"05bbd40f8711bfce06fe7f7235846e1b2664b16e77e82f7096d4d7770b2cd944"} Sep 18 11:34:33.515477 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.515416 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fd687d7f9-726wb" podStartSLOduration=1.69598552 podStartE2EDuration="2.515396784s" totalImagesPullingTime="819.411264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 11:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:34:33.514247044 +0000 UTC m=+795.762151353" watchObservedRunningTime="2026-09-18 11:34:33.515396784 +0000 UTC m=+795.763301091" Sep 18 11:34:33.550310 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.550273 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:34:33.550827 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.550761 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f498b9dbb-prtns" podUID="51ffc592-0976-453f-8c05-559e89e53f59" containerName="authorino" containerID="cri-o://5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b" gracePeriod=30 Sep 18 11:34:33.815115 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.815084 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:34:33.827217 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.827194 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert\") pod \"51ffc592-0976-453f-8c05-559e89e53f59\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " Sep 18 11:34:33.827386 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.827256 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgft\" (UniqueName: \"kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft\") pod \"51ffc592-0976-453f-8c05-559e89e53f59\" (UID: \"51ffc592-0976-453f-8c05-559e89e53f59\") " Sep 18 11:34:33.829640 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.829607 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft" (OuterVolumeSpecName: "kube-api-access-djgft") pod "51ffc592-0976-453f-8c05-559e89e53f59" (UID: "51ffc592-0976-453f-8c05-559e89e53f59"). InnerVolumeSpecName "kube-api-access-djgft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:34:33.840094 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.840063 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "51ffc592-0976-453f-8c05-559e89e53f59" (UID: "51ffc592-0976-453f-8c05-559e89e53f59"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 11:34:33.916701 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.916665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:33.928752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.928726 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/51ffc592-0976-453f-8c05-559e89e53f59-tls-cert\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:34:33.928752 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:33.928753 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgft\" (UniqueName: \"kubernetes.io/projected/51ffc592-0976-453f-8c05-559e89e53f59-kube-api-access-djgft\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:34:34.109188 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.109091 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:34:34.109389 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.109352 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" podUID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" containerName="payload-pre-processing" containerID="cri-o://6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14" gracePeriod=30 Sep 18 11:34:34.128935 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.128901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:34.230036 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.230003 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:34.344873 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.344847 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:34:34.433519 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.433491 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume\") pod \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " Sep 18 11:34:34.433705 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.433533 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wftrt\" (UniqueName: \"kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt\") pod \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\" (UID: \"a1c48dac-4492-4498-b76d-6f5f90cf9d08\") " Sep 18 11:34:34.433868 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.433844 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1c48dac-4492-4498-b76d-6f5f90cf9d08" (UID: "a1c48dac-4492-4498-b76d-6f5f90cf9d08"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 11:34:34.435901 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.435867 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt" (OuterVolumeSpecName: "kube-api-access-wftrt") pod "a1c48dac-4492-4498-b76d-6f5f90cf9d08" (UID: "a1c48dac-4492-4498-b76d-6f5f90cf9d08"). InnerVolumeSpecName "kube-api-access-wftrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 11:34:34.501067 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.501025 2579 generic.go:356] "Generic (PLEG): container finished" podID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" containerID="6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14" exitCode=0 Sep 18 11:34:34.501535 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.501124 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" Sep 18 11:34:34.501535 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.501162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" event={"ID":"a1c48dac-4492-4498-b76d-6f5f90cf9d08","Type":"ContainerDied","Data":"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14"} Sep 18 11:34:34.501535 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.501224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt" event={"ID":"a1c48dac-4492-4498-b76d-6f5f90cf9d08","Type":"ContainerDied","Data":"12c5242472b82528de79192b03248f244b8db079b0a2d570ce43eef3eef5428f"} Sep 18 11:34:34.501535 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.501255 2579 scope.go:117] "RemoveContainer" containerID="6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14" Sep 18 11:34:34.502784 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.502763 2579 generic.go:356] "Generic (PLEG): container finished" podID="51ffc592-0976-453f-8c05-559e89e53f59" containerID="5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b" exitCode=0 Sep 18 11:34:34.502917 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.502814 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f498b9dbb-prtns" Sep 18 11:34:34.502917 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.502850 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f498b9dbb-prtns" event={"ID":"51ffc592-0976-453f-8c05-559e89e53f59","Type":"ContainerDied","Data":"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b"} Sep 18 11:34:34.503059 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.502920 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f498b9dbb-prtns" event={"ID":"51ffc592-0976-453f-8c05-559e89e53f59","Type":"ContainerDied","Data":"16342b3f246305ccc580318a0f48e87a2a5a32dac669c10a3aaef7230cc1ac19"} Sep 18 11:34:34.511090 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.511071 2579 scope.go:117] "RemoveContainer" containerID="6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14" Sep 18 11:34:34.511458 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:34:34.511442 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14\": container with ID starting with 6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14 not found: ID does not exist" containerID="6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14" Sep 18 11:34:34.511536 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.511469 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14"} err="failed to get container status \"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14\": rpc error: code = NotFound desc = could not find container \"6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14\": container with ID starting with 6d25723f7a343fe4a899b4acc8db453c78f9b96821507433dec673997ff3ef14 not found: ID does not exist" Sep 18 11:34:34.511536 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.511491 2579 scope.go:117] "RemoveContainer" containerID="5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b" Sep 18 11:34:34.519145 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.519126 2579 scope.go:117] "RemoveContainer" containerID="5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b" Sep 18 11:34:34.519443 ip-10-0-140-158 kubenswrapper[2579]: E0918 11:34:34.519406 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b\": container with ID starting with 5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b not found: ID does not exist" containerID="5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b" Sep 18 11:34:34.519535 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.519440 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b"} err="failed to get container status \"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b\": rpc error: code = NotFound desc = could not find container \"5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b\": container with ID starting with 5d61fc676024155adda1da638e3ea7ad21f910b116809079f9a19e78b4a51c5b not found: ID does not exist" Sep 18 11:34:34.521410 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.521391 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:34:34.524820 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.524803 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f498b9dbb-prtns"] Sep 18 11:34:34.534447 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.534425 2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1c48dac-4492-4498-b76d-6f5f90cf9d08-plugins-config-volume\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:34:34.534447 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.534444 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wftrt\" (UniqueName: \"kubernetes.io/projected/a1c48dac-4492-4498-b76d-6f5f90cf9d08-kube-api-access-wftrt\") on node \"ip-10-0-140-158.ec2.internal\" DevicePath \"\"" Sep 18 11:34:34.541115 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.541090 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:34:34.550591 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:34.550570 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9whgt"] Sep 18 11:34:36.248980 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:36.248944 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ffc592-0976-453f-8c05-559e89e53f59" path="/var/lib/kubelet/pods/51ffc592-0976-453f-8c05-559e89e53f59/volumes" Sep 18 11:34:36.249384 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:36.249350 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" path="/var/lib/kubelet/pods/a1c48dac-4492-4498-b76d-6f5f90cf9d08/volumes" Sep 18 11:34:58.082875 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:58.082832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:34:58.185503 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:34:58.185466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:36:18.690184 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:36:18.690065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:36:18.695336 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:36:18.691598 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpl85_8cf58951-7c8f-427f-b755-58c00a687044/ovn-acl-logging/0.log" Sep 18 11:37:49.781349 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:49.781268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:37:51.228392 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:51.228362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" limit=1024 Sep 18 11:37:52.652273 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:52.652246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8xx7n_f1ea3303-23f9-4d8c-8df7-34704cb6afbb/global-pull-secret-syncer/0.log" Sep 18 11:37:52.816539 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:52.816480 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4ppq4_2dddf419-57a1-4ad9-9412-80f60ef2d23b/konnectivity-agent/0.log" Sep 18 11:37:52.925536 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:52.925422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-158.ec2.internal_fd0095d41d65225b982774533d3effbe/haproxy/0.log" Sep 18 11:37:57.168410 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:57.168379 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fd687d7f9-726wb_c8240edf-bf8e-4bb0-8e07-a8bf9d443fbb/authorino/0.log" Sep 18 11:37:59.215402 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:59.215357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b49cc8fdc-f92lx_e47d4cc4-dc84-4952-a80e-9a05191d73b1/metrics-server/0.log" Sep 18 11:37:59.247896 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:59.247871 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-ngmpt_e9823098-4aec-496c-b334-7ba0abf44c8a/monitoring-plugin/0.log" Sep 18 11:37:59.365109 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:59.365080 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c2tt5_6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9/node-exporter/0.log" Sep 18 11:37:59.389434 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:59.389415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c2tt5_6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9/kube-rbac-proxy/0.log" Sep 18 11:37:59.412334 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:37:59.412313 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c2tt5_6fd6a90f-f29b-48b5-9ee1-8421b5ce70d9/init-textfile/0.log" Sep 18 11:38:02.667649 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.667618 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh"] Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.667933 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ffc592-0976-453f-8c05-559e89e53f59" containerName="authorino" Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.667943 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ffc592-0976-453f-8c05-559e89e53f59" containerName="authorino" Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.667960 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" containerName="payload-pre-processing" Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.667965 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" containerName="payload-pre-processing" Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.668025 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c48dac-4492-4498-b76d-6f5f90cf9d08" containerName="payload-pre-processing" Sep 18 11:38:02.668089 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.668034 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ffc592-0976-453f-8c05-559e89e53f59" containerName="authorino" Sep 18 11:38:02.670919 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.670902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.673554 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.673535 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6grnj\"/\"openshift-service-ca.crt\"" Sep 18 11:38:02.673662 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.673593 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6grnj\"/\"default-dockercfg-478mw\"" Sep 18 11:38:02.673722 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.673667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6grnj\"/\"kube-root-ca.crt\"" Sep 18 11:38:02.684915 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.684894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh"] Sep 18 11:38:02.765994 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.765960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-sys\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.766205 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.766035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-lib-modules\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.766205 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.766073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-proc\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.766205 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.766092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcd5\" (UniqueName: \"kubernetes.io/projected/bc989595-5de1-410b-8cf5-c19377284858-kube-api-access-ltcd5\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.766205 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.766115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-podres\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.866926 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.866884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-lib-modules\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.866951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-proc\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.866980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcd5\" (UniqueName: \"kubernetes.io/projected/bc989595-5de1-410b-8cf5-c19377284858-kube-api-access-ltcd5\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-podres\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-proc\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867084 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-lib-modules\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867138 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-sys\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867392 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-podres\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.867392 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.867208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc989595-5de1-410b-8cf5-c19377284858-sys\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.875529 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.875511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcd5\" (UniqueName: \"kubernetes.io/projected/bc989595-5de1-410b-8cf5-c19377284858-kube-api-access-ltcd5\") pod \"perf-node-gather-daemonset-h5gnh\" (UID: \"bc989595-5de1-410b-8cf5-c19377284858\") " pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:02.980517 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:02.980426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:03.252975 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:03.252951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh"] Sep 18 11:38:03.254893 ip-10-0-140-158 kubenswrapper[2579]: W0918 11:38:03.254864 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc989595_5de1_410b_8cf5_c19377284858.slice/crio-25076e263e5fcaed5b779dc78eef163fb92894be5471bf92a7a72baab32162cd WatchSource:0}: Error finding container 25076e263e5fcaed5b779dc78eef163fb92894be5471bf92a7a72baab32162cd: Status 404 returned error can't find the container with id 25076e263e5fcaed5b779dc78eef163fb92894be5471bf92a7a72baab32162cd Sep 18 11:38:03.443846 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:03.443812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" event={"ID":"bc989595-5de1-410b-8cf5-c19377284858","Type":"ContainerStarted","Data":"6037ed9d949d36f32780da2c506ba6d0c410b2dbacd7aeef6bb494955641972f"} Sep 18 11:38:03.444062 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:03.443860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" event={"ID":"bc989595-5de1-410b-8cf5-c19377284858","Type":"ContainerStarted","Data":"25076e263e5fcaed5b779dc78eef163fb92894be5471bf92a7a72baab32162cd"} Sep 18 11:38:03.444062 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:03.443880 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:03.464178 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:03.464135 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" podStartSLOduration=1.464117337 podStartE2EDuration="1.464117337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 11:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 11:38:03.461738108 +0000 UTC m=+1005.709642409" watchObservedRunningTime="2026-09-18 11:38:03.464117337 +0000 UTC m=+1005.712021687" Sep 18 11:38:04.814650 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:04.814620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2626p_ca6eebff-698f-40e8-94fc-effc82859ada/dns/0.log" Sep 18 11:38:04.842083 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:04.842055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2626p_ca6eebff-698f-40e8-94fc-effc82859ada/kube-rbac-proxy/0.log" Sep 18 11:38:04.990058 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:04.990028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97cp9_ee334868-22e2-4c03-80c9-7bfc3beb2aa9/dns-node-resolver/0.log" Sep 18 11:38:05.694449 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:05.694422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zmbpw_1f1d4fbb-ede0-48cf-9c28-d98695ed43da/node-ca/0.log" Sep 18 11:38:06.790686 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:06.790658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6d56fbfb-z7p7k_47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda/kube-auth-proxy/0.log" Sep 18 11:38:07.637298 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:07.637271 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k6rq5_c6bc485a-1a7e-47d4-89a3-32cc283b0b6e/serve-healthcheck-canary/0.log" Sep 18 11:38:08.319901 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:08.319873 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqj6m_38866fee-916c-4397-b667-ce7156c469c1/kube-rbac-proxy/0.log" Sep 18 11:38:08.352312 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:08.352290 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqj6m_38866fee-916c-4397-b667-ce7156c469c1/exporter/0.log" Sep 18 11:38:08.381738 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:08.381714 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqj6m_38866fee-916c-4397-b667-ce7156c469c1/extractor/0.log" Sep 18 11:38:09.458623 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:09.458580 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6grnj/perf-node-gather-daemonset-h5gnh" Sep 18 11:38:10.880173 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:10.880138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-kvdtp_3463177d-135c-43ae-b4d0-2ef3839c7247/server/0.log" Sep 18 11:38:10.933870 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:10.933838 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dkpbt_0e6fee1f-be8d-4215-86e3-eef5bd8816db/manager/0.log" Sep 18 11:38:10.965153 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:10.965128 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7cf8495-bx52z_a2e9111a-b476-46ec-9776-ce9aa2c6120a/manager/0.log" Sep 18 11:38:10.997656 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:10.997631 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7cf8495-bx52z_a2e9111a-b476-46ec-9776-ce9aa2c6120a/copy-manifests/0.log" Sep 18 11:38:12.653191 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:12.653162 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c77776b6b-x98rg_5294a1f3-f8dd-409f-8c70-b977435bed18/manager/0.log" Sep 18 11:38:13.176228 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:13.176186 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6d56fbfb-z7p7k_47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda/kube-auth-proxy/0.log" Sep 18 11:38:14.454772 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:14.454746 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6d56fbfb-z7p7k_47e0f261-ae6d-45f5-8e5b-6c4e2b28ceda/kube-auth-proxy/0.log" Sep 18 11:38:18.208365 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:18.208332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-j7j4q_a67a86e9-772d-4292-9c1e-6bbeccd71845/migrator/0.log" Sep 18 11:38:18.229946 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:18.229919 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-j7j4q_a67a86e9-772d-4292-9c1e-6bbeccd71845/graceful-termination/0.log" Sep 18 11:38:19.779756 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.779731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/kube-multus-additional-cni-plugins/0.log" Sep 18 11:38:19.803211 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.803189 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/egress-router-binary-copy/0.log" Sep 18 11:38:19.825532 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.825511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/cni-plugins/0.log" Sep 18 11:38:19.856135 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.856112 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/bond-cni-plugin/0.log" Sep 18 11:38:19.884786 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.884763 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/routeoverride-cni/0.log" Sep 18 11:38:19.909803 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.909785 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/whereabouts-cni-bincopy/0.log" Sep 18 11:38:19.935382 ip-10-0-140-158 kubenswrapper[2579]: I0918 11:38:19.935361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s88tc_25a6b185-d5c0-4633-9cd3-c98282495bad/whereabouts-cni/0.log"