Sep 17 19:06:29.276671 ip-10-0-139-216 systemd[1]: Starting Kubernetes Kubelet... Sep 17 19:06:32.876644 ip-10-0-139-216 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 19:06:32.876644 ip-10-0-139-216 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 19:06:32.876644 ip-10-0-139-216 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 19:06:32.876644 ip-10-0-139-216 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 19:06:32.876644 ip-10-0-139-216 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 19:06:32.877586 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.876742 2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 19:06:32.881303 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881286 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.881303 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881302 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881306 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881310 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881313 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881316 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881319 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881322 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881324 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881327 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881330 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881332 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881335 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881343 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881346 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881359 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881362 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881364 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881367 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881371 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.881397 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881375 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881378 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881381 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881384 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881388 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881393 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881396 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881401 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881404 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881407 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881410 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881413 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881416 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881419 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881422 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881425 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881428 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881431 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881435 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.881904 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881438 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881441 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881443 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881446 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881449 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881452 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881454 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881457 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881459 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881462 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881464 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881467 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881469 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881472 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881474 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881478 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881481 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881484 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881487 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881489 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.882396 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881492 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881495 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881497 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881499 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881502 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881506 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881509 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881511 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881514 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881516 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881519 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881521 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881524 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881527 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881529 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881532 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881534 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881537 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881539 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881542 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881544 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.882911 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881547 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881549 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881552 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881555 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881557 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881560 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881563 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881566 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881568 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881571 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881573 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881576 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881579 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881581 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881584 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881586 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881589 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881592 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.881595 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.883458 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882289 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882296 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882299 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882302 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882305 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882308 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882311 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882313 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882316 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882319 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882322 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882324 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882327 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882329 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882332 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882334 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882337 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882340 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882343 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882346 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.883929 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882363 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882366 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882369 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882371 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882374 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882377 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882380 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882383 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882386 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882388 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882392 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882396 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882399 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882401 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882404 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882407 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882411 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882415 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882419 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.884481 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882422 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882425 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882427 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882430 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882432 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882435 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882438 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882440 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882442 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882445 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882447 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882450 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882454 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882457 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882459 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882462 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882465 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882467 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882470 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882472 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.884984 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882475 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882478 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882480 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882483 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882485 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882488 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882490 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882492 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882496 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882500 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882503 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882506 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882509 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882512 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882514 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882517 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882520 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882522 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882525 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.885513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882527 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882530 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882532 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882535 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882539 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882542 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882544 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882547 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882550 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882552 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882555 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882557 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882560 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882563 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882565 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882568 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882570 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882572 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882575 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882578 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.885985 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882580 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882941 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882946 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882948 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882951 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882954 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882957 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882960 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882963 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882965 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882970 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882973 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882976 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882979 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882982 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882985 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882988 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882990 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882993 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.886494 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882996 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.882999 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883002 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883004 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883007 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883009 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883013 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883017 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883019 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883022 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883025 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883028 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883030 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883033 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883035 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883038 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883041 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883043 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883046 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.886971 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883049 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883051 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883054 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883056 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883059 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883061 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883064 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883073 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883077 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883079 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883082 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883085 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883088 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883090 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883093 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883096 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883098 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883101 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883104 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883106 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.887463 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883109 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883111 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883114 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883116 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883119 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883122 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883124 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883127 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883129 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883133 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883135 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883138 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883140 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883143 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883146 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883149 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883151 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883154 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883156 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883159 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.887965 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883162 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883164 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883167 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883172 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883175 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883178 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883180 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883183 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883185 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883188 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883191 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883193 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883196 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883199 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883202 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883205 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883207 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883210 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883212 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.888474 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883215 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883218 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.883220 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883291 2588 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883331 2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883337 2588 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883343 2588 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883362 2588 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883368 2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883374 2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883391 2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883395 2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883398 2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883402 2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883405 2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883408 2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883414 2588 flags.go:64] FLAG: --cgroup-root="" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883417 2588 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883420 2588 flags.go:64] FLAG: --client-ca-file="" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883422 2588 flags.go:64] FLAG: --cloud-provider="external" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883426 2588 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883430 2588 flags.go:64] FLAG: --cluster-domain="" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883433 2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883437 2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 19:06:32.888944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883440 2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883443 2588 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883447 2588 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883452 2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883455 2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883459 2588 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883462 2588 flags.go:64] FLAG: --contention-profiling="false" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883465 2588 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883468 2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883472 2588 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883475 2588 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883479 2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883482 2588 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883485 2588 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883488 2588 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883493 2588 flags.go:64] FLAG: --enable-server="true" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883496 2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883504 2588 flags.go:64] FLAG: --event-burst="100" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883507 2588 flags.go:64] FLAG: --event-qps="50" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883510 2588 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883513 2588 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883516 2588 flags.go:64] FLAG: --eviction-hard="" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883520 2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883523 2588 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883527 2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 19:06:32.889567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883531 2588 flags.go:64] FLAG: --eviction-soft="" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883533 2588 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883536 2588 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883539 2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883542 2588 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883545 2588 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883548 2588 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883551 2588 flags.go:64] FLAG: --feature-gates="" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883555 2588 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883558 2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883561 2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883564 2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883567 2588 flags.go:64] FLAG: --healthz-port="10248" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883570 2588 flags.go:64] FLAG: --help="false" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883573 2588 flags.go:64] FLAG: --hostname-override="ip-10-0-139-216.ec2.internal" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883576 2588 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883579 2588 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883582 2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883585 2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883589 2588 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883592 2588 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883594 2588 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883599 2588 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 19:06:32.890180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883601 2588 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883605 2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883608 2588 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883611 2588 flags.go:64] FLAG: --kube-reserved="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883614 2588 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883616 2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883619 2588 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883622 2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883626 2588 flags.go:64] FLAG: --lock-file="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883629 2588 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883632 2588 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883635 2588 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883641 2588 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883644 2588 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883646 2588 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883650 2588 flags.go:64] FLAG: --logging-format="text" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883653 2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883656 2588 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883659 2588 flags.go:64] FLAG: --manifest-url="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883662 2588 flags.go:64] FLAG: --manifest-url-header="" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883666 2588 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883670 2588 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883673 2588 flags.go:64] FLAG: --max-pods="110" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883676 2588 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883679 2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 19:06:32.890861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883682 2588 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883685 2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883688 2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883691 2588 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883694 2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883701 2588 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883705 2588 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883708 2588 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883712 2588 flags.go:64] FLAG: --pod-cidr="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883715 2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883720 2588 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883724 2588 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883727 2588 flags.go:64] FLAG: --pods-per-core="0" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883730 2588 flags.go:64] FLAG: --port="10250" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883733 2588 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883736 2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024a4bbeaf1ae20ef" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883741 2588 flags.go:64] FLAG: --qos-reserved="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883744 2588 flags.go:64] FLAG: --read-only-port="10255" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883747 2588 flags.go:64] FLAG: --register-node="true" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883750 2588 flags.go:64] FLAG: --register-with-taints="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883753 2588 flags.go:64] FLAG: --registry-burst="10" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883756 2588 flags.go:64] FLAG: --registry-qps="5" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883759 2588 flags.go:64] FLAG: --reserved-cpus="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883762 2588 flags.go:64] FLAG: --reserved-memory="" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883765 2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 19:06:32.891512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883769 2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883772 2588 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883774 2588 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883778 2588 flags.go:64] FLAG: --runonce="false" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883780 2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883784 2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883786 2588 flags.go:64] FLAG: --seccomp-default="false" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883789 2588 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883792 2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883795 2588 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883798 2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883802 2588 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883805 2588 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883809 2588 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883812 2588 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883815 2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883818 2588 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883821 2588 flags.go:64] FLAG: --system-cgroups="" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883824 2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883830 2588 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883833 2588 flags.go:64] FLAG: --tls-cert-file="" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883836 2588 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883841 2588 flags.go:64] FLAG: --tls-min-version="" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883845 2588 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883848 2588 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 19:06:32.892130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883850 2588 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883853 2588 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883856 2588 flags.go:64] FLAG: --v="2" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883860 2588 flags.go:64] FLAG: --version="false" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883864 2588 flags.go:64] FLAG: --vmodule="" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883868 2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.883872 2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884004 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884008 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884011 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884014 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884017 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884020 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884023 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884026 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884028 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884031 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884034 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884037 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884040 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884044 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.892773 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884047 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884050 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884054 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884057 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884060 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884063 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884066 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884069 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884072 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884075 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884078 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884080 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884083 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884085 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884088 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884090 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884093 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884095 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884098 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.893284 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884100 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884103 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884106 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884109 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884111 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884114 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884116 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884119 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884121 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884124 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884126 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884129 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884133 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884137 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884140 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884143 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884146 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884149 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884152 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884156 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.893797 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884158 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884161 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884165 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884167 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884170 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884173 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884175 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884178 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884180 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884183 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884186 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884188 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884191 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884194 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884196 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884199 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884201 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884204 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884207 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.894296 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884210 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884214 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884217 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884220 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884223 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884226 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884229 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884232 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884235 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884237 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884240 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884243 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884246 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884248 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884251 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884254 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884256 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884259 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884261 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884264 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.894799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884267 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884269 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884272 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884274 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884277 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884280 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.884282 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.885046 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892173 2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892190 2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892211 2588 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892217 2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892275 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892279 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.895301 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892283 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892286 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892289 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892291 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892294 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892297 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892302 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892306 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892309 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892312 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892315 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892318 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892321 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892324 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892327 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892330 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892333 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892336 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892338 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.895676 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892341 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892344 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892347 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892361 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892364 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892367 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892369 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892372 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892376 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892379 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892382 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892385 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892388 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892391 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892394 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892396 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892399 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892403 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892407 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892411 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.896140 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892413 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892416 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892419 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892421 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892425 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892427 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892430 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892433 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892435 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892439 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892443 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892446 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892449 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892452 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892455 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892458 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892460 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892463 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892466 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892468 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.896712 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892471 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892474 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892477 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892479 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892482 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892485 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892487 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892490 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892493 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892496 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892498 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892501 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892503 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892506 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892509 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892511 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892514 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892517 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892519 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892522 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.897211 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892524 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892527 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892529 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892532 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892534 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892537 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892540 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892542 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892545 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892547 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892550 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892553 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892556 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892558 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892561 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892564 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892567 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.897979 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892570 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892575 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892695 2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892700 2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892703 2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892707 2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892711 2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892715 2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892717 2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892722 2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892725 2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892728 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892731 2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892734 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 19:06:32.898544 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892737 2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892740 2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892743 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892745 2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892747 2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892750 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892753 2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892756 2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892758 2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892761 2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892764 2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892766 2588 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892769 2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892772 2588 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892775 2588 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892778 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892781 2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892784 2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892786 2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892789 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 19:06:32.899090 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892792 2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892794 2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892797 2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892799 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892802 2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892804 2588 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892807 2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892809 2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892812 2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892814 2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892817 2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892820 2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892823 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892825 2588 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892828 2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892831 2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892833 2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892836 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892839 2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892841 2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 19:06:32.899793 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892844 2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892846 2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892850 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892852 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892854 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892857 2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892860 2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892863 2588 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892865 2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892868 2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892870 2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892873 2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892875 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892878 2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892880 2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892883 2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892885 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892888 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892890 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892893 2588 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 19:06:32.900285 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892895 2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892899 2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892902 2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892905 2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892907 2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892910 2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892913 2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892915 2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892918 2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892921 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892924 2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892926 2588 feature_gate.go:328] unrecognized feature gate: Example Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892929 2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892931 2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892934 2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892936 2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892939 2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892941 2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892947 2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 19:06:32.900917 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892949 2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892952 2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892954 2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892957 2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892960 2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892962 2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892965 2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:32.892967 2588 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.892972 2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.893085 2588 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.896202 2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.897343 2588 server.go:1019] "Starting client certificate rotation" Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.897474 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.897520 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 19:06:32.901502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.900728 2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 19:06:32.904424 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.904397 2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 19:06:32.908697 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.908672 2588 log.go:25] "Validated CRI v1 runtime API" Sep 17 19:06:32.911650 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.911633 2588 log.go:25] "Validated CRI v1 image API" Sep 17 19:06:32.912473 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.912456 2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 19:06:32.914983 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.914962 2588 fs.go:135] Filesystem UUIDs: map[2b8b159d-d9cc-48d9-9594-253bddb04b95:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e7a4683c-1dfe-49f3-a510-466a1f51c35b:/dev/nvme0n1p4] Sep 17 19:06:32.915060 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.914981 2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 19:06:32.919443 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.919291 2588 manager.go:216] Machine: {Timestamp:2026-09-17 19:06:32.918767594 +0000 UTC m=+1.979619212 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105579 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a72ff5828ce4b665d593f4fcddbef SystemUUID:ec2a72ff-5828-ce4b-665d-593f4fcddbef BootID:77a2f731-61c0-4297-afd2-e45db1a264b6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cc:ba:a6:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cc:ba:a6:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:e6:46:c8:f2:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 19:06:32.919443 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.919434 2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 19:06:32.919569 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.919525 2588 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 19:06:32.921297 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.921263 2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 19:06:32.921492 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.921301 2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 19:06:32.922780 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.922768 2588 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 19:06:32.922847 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.922790 2588 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 19:06:32.922847 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.922802 2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 19:06:32.922847 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.922817 2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 19:06:32.924119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.924106 2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 19:06:32.927419 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927404 2588 state_mem.go:36] "Initialized new in-memory state store" Sep 17 19:06:32.927562 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927551 2588 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 19:06:32.927624 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927594 2588 kubelet.go:486] "Attempting to sync node with API server" Sep 17 19:06:32.927624 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927609 2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 19:06:32.927624 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927624 2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 19:06:32.927746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927639 2588 kubelet.go:398] "Adding apiserver pod source" Sep 17 19:06:32.927746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.927654 2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 19:06:32.928511 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.928492 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 19:06:32.928593 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.928519 2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 19:06:32.931142 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.931111 2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 19:06:32.933467 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.933450 2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 19:06:32.933528 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.933481 2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 19:06:32.934599 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934571 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 19:06:32.934599 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934599 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934613 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934623 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934638 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934646 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934666 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934675 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934687 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934695 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934712 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934720 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 19:06:32.934758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934758 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 19:06:32.935087 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.934767 2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 19:06:32.938646 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.938628 2588 server.go:1268] "Started kubelet" Sep 17 19:06:32.938793 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.938735 2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 19:06:32.939220 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.938908 2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 19:06:32.939557 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.939536 2588 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 19:06:32.939606 ip-10-0-139-216 systemd[1]: Started Kubernetes Kubelet. Sep 17 19:06:32.971300 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.971229 2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 19:06:32.973983 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.973961 2588 server.go:310] "Adding debug handlers to kubelet server" Sep 17 19:06:32.973983 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.973938 2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 19:06:32.975452 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.975430 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 19:06:32.975633 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.975615 2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 19:06:32.975834 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.975812 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 19:06:32.975878 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.975812 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 19:06:32.980379 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.980364 2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 19:06:32.980379 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.980377 2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 19:06:32.980520 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.980496 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:32.981054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981036 2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 19:06:32.981054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981038 2588 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 19:06:32.981196 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981063 2588 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 19:06:32.981196 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981174 2588 reconstruct.go:97] "Volume reconstruction finished" Sep 17 19:06:32.981196 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981181 2588 reconciler.go:29] "Reconciler: start to sync state" Sep 17 19:06:32.981451 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.979683 2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-216.ec2.internal.18d631320b91fc36 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-216.ec2.internal,UID:ip-10-0-139-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-216.ec2.internal,},FirstTimestamp:2026-09-17 19:06:32.938593334 +0000 UTC m=+1.999444953,LastTimestamp:2026-09-17 19:06:32.938593334 +0000 UTC m=+1.999444953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-216.ec2.internal,}" Sep 17 19:06:32.981522 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981509 2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 19:06:32.981578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981525 2588 factory.go:55] Registering systemd factory Sep 17 19:06:32.981578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981534 2588 factory.go:223] Registration of the systemd container factory successfully Sep 17 19:06:32.981756 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981743 2588 factory.go:153] Registering CRI-O factory Sep 17 19:06:32.981756 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981756 2588 factory.go:223] Registration of the crio container factory successfully Sep 17 19:06:32.981861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981785 2588 factory.go:103] Registering Raw factory Sep 17 19:06:32.981861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.981801 2588 manager.go:1196] Started watching for new ooms in manager Sep 17 19:06:32.982403 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.982389 2588 manager.go:349] Starting recovery of all containers Sep 17 19:06:32.990544 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.990510 2588 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 19:06:32.990544 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:32.990519 2588 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 19:06:32.995721 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.995697 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtsrj" Sep 17 19:06:32.996604 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:32.996456 2588 manager.go:354] Recovery completed Sep 17 19:06:33.000565 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.000549 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.002678 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.002661 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.002765 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.002690 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.002765 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.002700 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.003267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.003253 2588 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 19:06:33.003267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.003264 2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 19:06:33.003375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.003282 2588 state_mem.go:36] "Initialized new in-memory state store" Sep 17 19:06:33.003375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.003302 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.003733 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.003718 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtsrj" Sep 17 19:06:33.004068 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.004055 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.004127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.004080 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.004127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.004092 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.005052 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.005039 2588 policy_none.go:49] "None policy: Start" Sep 17 19:06:33.005109 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.005062 2588 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 19:06:33.005109 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.005078 2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 19:06:33.005250 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.005116 2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-216.ec2.internal.18d631320f63d517 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-216.ec2.internal,UID:ip-10-0-139-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-216.ec2.internal,},FirstTimestamp:2026-09-17 19:06:33.002677527 +0000 UTC m=+2.063529146,LastTimestamp:2026-09-17 19:06:33.002677527 +0000 UTC m=+2.063529146,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-216.ec2.internal,}" Sep 17 19:06:33.006070 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.006057 2588 policy_none.go:47] "Start" Sep 17 19:06:33.072054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072029 2588 manager.go:337] "Starting Device Plugin manager" Sep 17 19:06:33.072198 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.072083 2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 19:06:33.072198 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072098 2588 server.go:87] "Starting device plugin registration server" Sep 17 19:06:33.072446 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072434 2588 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 19:06:33.072507 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072457 2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 19:06:33.072654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072628 2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 19:06:33.072754 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072732 2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 19:06:33.072754 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.072742 2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 19:06:33.073670 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.073647 2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 19:06:33.073783 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.073696 2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.115584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.115543 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 19:06:33.116844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.116819 2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 19:06:33.116907 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.116887 2588 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 19:06:33.116949 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.116916 2588 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 19:06:33.116984 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.116964 2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 19:06:33.119498 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.119476 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:33.172846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.172769 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.173772 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.173755 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.173865 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.173785 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.173865 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.173796 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.173865 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.173818 2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.183310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.183294 2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.183381 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.183317 2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-216.ec2.internal\": node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.205624 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.205600 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.217658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.217634 2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal"] Sep 17 19:06:33.217717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.217704 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.218653 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.218636 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.218717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.218667 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.218717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.218678 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.219896 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.219884 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.220073 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220058 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.220110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220090 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.220699 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220673 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.220699 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220699 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.220846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220706 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.220846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220717 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.220846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220722 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.220846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.220731 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.222016 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.221999 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.222124 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.222026 2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 19:06:33.222848 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.222830 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientMemory" Sep 17 19:06:33.222919 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.222863 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 19:06:33.222919 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.222875 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeHasSufficientPID" Sep 17 19:06:33.250250 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.250228 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-216.ec2.internal\" not found" node="ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.254710 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.254691 2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-216.ec2.internal\" not found" node="ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.282334 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.282307 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.282469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.282339 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.282469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.282376 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96b467e339b8d6495a764e5b20a26147-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"96b467e339b8d6495a764e5b20a26147\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.306209 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.306182 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.383408 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383373 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.383408 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383409 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.383601 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383425 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96b467e339b8d6495a764e5b20a26147-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"96b467e339b8d6495a764e5b20a26147\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.383601 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383414 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.383601 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383462 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96b467e339b8d6495a764e5b20a26147-config\") pod \"kube-apiserver-proxy-ip-10-0-139-216.ec2.internal\" (UID: \"96b467e339b8d6495a764e5b20a26147\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.383601 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.383507 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/969ab8ad73131b876c88709692cad35c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal\" (UID: \"969ab8ad73131b876c88709692cad35c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.406939 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.406906 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.507642 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.507580 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.554755 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.554727 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.559250 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.559060 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.608210 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.608177 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.708713 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.708682 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.809331 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.809256 2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-216.ec2.internal\" not found" Sep 17 19:06:33.859615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.859592 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:33.881450 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.881419 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.896729 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.896707 2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 19:06:33.896857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.896835 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 19:06:33.896925 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.896867 2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 19:06:33.896925 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.896890 2588 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://abc1f6965c8d64e8bb1a86cc687799cf-7f916782a3580071.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.139.216:56858->44.193.152.108:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.896925 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.896915 2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" Sep 17 19:06:33.916368 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.916335 2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 19:06:33.928496 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.928473 2588 apiserver.go:52] "Watching apiserver" Sep 17 19:06:33.934577 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.934559 2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 19:06:33.934931 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.934907 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-x4w49","openshift-ovn-kubernetes/ovnkube-node-rgsp4","kube-system/konnectivity-agent-2txw9","kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc","openshift-dns/node-resolver-z4njp","openshift-image-registry/node-ca-wn8z5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-lmdzn","openshift-multus/network-metrics-daemon-82nmg","kube-system/global-pull-secret-syncer-fdzrj","openshift-cluster-node-tuning-operator/tuned-hv7gw","openshift-multus/multus-lqm56","openshift-network-diagnostics/network-check-target-kftjw"] Sep 17 19:06:33.936615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.936596 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:33.938422 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.938401 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.938993 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.938977 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.939167 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.939147 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 19:06:33.939718 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.939566 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cf44v\"" Sep 17 19:06:33.939867 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.939840 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.942505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942092 2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:33.942505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942315 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:33.942661 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942541 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 19:06:33.942661 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942562 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.942760 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942695 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.942949 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942926 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 19:06:33.942949 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.942941 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 19:06:33.943153 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.943136 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nrsff\"" Sep 17 19:06:33.943844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.943828 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.943939 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.943846 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 19:06:33.944880 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.944861 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 19:06:33.944966 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.944916 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gn5c9\"" Sep 17 19:06:33.945198 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945185 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 19:06:33.945254 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945231 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:33.945957 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945936 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mxc8\"" Sep 17 19:06:33.946048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945958 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 19:06:33.946048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945990 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.946048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.945940 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.946434 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.946420 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:33.947797 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.947782 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.948883 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948864 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.948959 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948884 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.948959 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948884 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.948959 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948940 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 19:06:33.949101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948988 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gpm2r\"" Sep 17 19:06:33.949101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.948887 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8jv8k\"" Sep 17 19:06:33.949243 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.949230 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:33.949336 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.949298 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:33.949336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.949310 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.949679 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.949666 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ngrh4\"" Sep 17 19:06:33.950713 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.950607 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:33.950713 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.950646 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 19:06:33.950713 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.950647 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.950713 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.950670 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:33.950713 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.950687 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 19:06:33.950964 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.950692 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 19:06:33.951035 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.951023 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.951944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.951928 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.953405 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.953383 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.953961 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.953945 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 19:06:33.954195 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.954181 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dk7l2\"" Sep 17 19:06:33.954195 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.954191 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 19:06:33.955167 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.955152 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:33.955222 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:33.955205 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:33.955386 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.955374 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 19:06:33.955882 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.955865 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6zldl\"" Sep 17 19:06:33.980654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.980632 2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 19:06:33.982050 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.982033 2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 19:06:33.987295 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987271 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987302 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-sys\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987323 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-var-lib-kubelet\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987371 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-systemd-units\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987394 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-env-overrides\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987417 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987466 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-k8s-cni-cncf-io\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987493 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987519 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/338835f8-b011-4ae7-83ce-617622894a0e-iptables-alerter-script\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987534 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-cnibin\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.987556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987548 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysconfig\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987562 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-kubelet\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987595 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-var-lib-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987618 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-log-socket\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987633 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-script-lib\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987655 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-modprobe-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987673 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-lib-modules\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987686 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-node-log\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987700 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftbmt\" (UniqueName: \"kubernetes.io/projected/216976d1-3300-45da-9dd3-e019e573c5ee-kube-api-access-ftbmt\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987717 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-ovn\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987748 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-multus\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.987776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987780 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-sys-fs\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987805 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/894742b2-7ee1-4566-a173-385f22ebd8ed-konnectivity-ca\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987830 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987853 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-etc-kubernetes\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987876 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll4j7\" (UniqueName: \"kubernetes.io/projected/16dbcd49-0e31-4944-8957-5b1055c9315a-kube-api-access-ll4j7\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987899 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987930 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z668t\" (UniqueName: \"kubernetes.io/projected/338835f8-b011-4ae7-83ce-617622894a0e-kube-api-access-z668t\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987953 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-etc-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.987978 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-netd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988002 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988035 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz9lp\" (UniqueName: \"kubernetes.io/projected/138625ed-563d-4553-9ef4-67e541c29dbd-kube-api-access-mz9lp\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988072 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-multus-certs\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988100 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-system-cni-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988123 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988145 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/338835f8-b011-4ae7-83ce-617622894a0e-host-slash\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988166 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-slash\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988189 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/216976d1-3300-45da-9dd3-e019e573c5ee-hosts-file\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988215 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/138625ed-563d-4553-9ef4-67e541c29dbd-serviceca\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988238 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988278 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg84l\" (UniqueName: \"kubernetes.io/projected/dd9536b0-b583-49a9-b19d-1c36e2134a37-kube-api-access-tg84l\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988305 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-systemd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988319 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988333 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq8bd\" (UniqueName: \"kubernetes.io/projected/34a9cdb8-0210-4d64-b5df-e88b71831d9c-kube-api-access-wq8bd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988374 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-kubernetes\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988398 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-tuned\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-netns\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988431 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-hostroot\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988444 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-socket-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988458 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-registration-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988478 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-kubelet-config\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988511 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-dbus\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988542 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-systemd\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.988960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988564 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/216976d1-3300-45da-9dd3-e019e573c5ee-tmp-dir\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988582 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988596 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-system-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988609 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-cnibin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988631 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-kubelet\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988648 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqrm8\" (UniqueName: \"kubernetes.io/projected/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-kube-api-access-nqrm8\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988671 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-cni-binary-copy\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988686 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-netns\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988705 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-conf-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988730 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-daemon-config\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988765 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988788 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988823 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659c5\" (UniqueName: \"kubernetes.io/projected/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kube-api-access-659c5\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988852 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-conf\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988873 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-run\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988894 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-config\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.989563 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988920 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138625ed-563d-4553-9ef4-67e541c29dbd-host\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988942 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-socket-dir-parent\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988965 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-tmp\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.988996 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/894742b2-7ee1-4566-a173-385f22ebd8ed-agent-certs\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989033 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-device-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989087 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-host\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989113 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989138 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-bin\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989161 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovn-node-metrics-cert\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989185 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989209 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74dx\" (UniqueName: \"kubernetes.io/projected/2226e368-5e76-43fc-82ee-e837bab7359d-kube-api-access-s74dx\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:33.989996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.989233 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-bin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:33.995428 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:33.995406 2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:34.002062 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.002040 2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 19:06:34.007242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.007191 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 19:01:32 +0000 UTC" deadline="2028-05-02 13:05:42.213402552 +0000 UTC" Sep 17 19:06:34.007242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.007241 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14225h59m8.206165714s" Sep 17 19:06:34.031799 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.031759 2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5vxs" Sep 17 19:06:34.040041 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.040021 2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z5vxs" Sep 17 19:06:34.090425 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090397 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-script-lib\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090432 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-modprobe-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090456 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-lib-modules\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090475 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-node-log\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090497 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftbmt\" (UniqueName: \"kubernetes.io/projected/216976d1-3300-45da-9dd3-e019e573c5ee-kube-api-access-ftbmt\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090517 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-ovn\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090539 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-multus\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090578 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-node-log\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090591 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-multus\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.090628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090626 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-ovn\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090629 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-lib-modules\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090629 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-modprobe-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090658 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-sys-fs\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090701 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/894742b2-7ee1-4566-a173-385f22ebd8ed-konnectivity-ca\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090755 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-sys-fs\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090762 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090798 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-etc-kubernetes\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090826 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll4j7\" (UniqueName: \"kubernetes.io/projected/16dbcd49-0e31-4944-8957-5b1055c9315a-kube-api-access-ll4j7\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090850 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090862 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-etc-kubernetes\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090876 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z668t\" (UniqueName: \"kubernetes.io/projected/338835f8-b011-4ae7-83ce-617622894a0e-kube-api-access-z668t\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090913 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-etc-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090940 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-netd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090967 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.090993 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz9lp\" (UniqueName: \"kubernetes.io/projected/138625ed-563d-4553-9ef4-67e541c29dbd-kube-api-access-mz9lp\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-multus-certs\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091040 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-system-cni-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091051 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-script-lib\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091062 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091113 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-etc-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091124 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/894742b2-7ee1-4566-a173-385f22ebd8ed-konnectivity-ca\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091140 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/338835f8-b011-4ae7-83ce-617622894a0e-host-slash\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091155 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-netd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091167 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-slash\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.091201 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091208 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/216976d1-3300-45da-9dd3-e019e573c5ee-hosts-file\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091237 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/138625ed-563d-4553-9ef4-67e541c29dbd-serviceca\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.091271 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:06:34.591248789 +0000 UTC m=+3.652100412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091287 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091314 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg84l\" (UniqueName: \"kubernetes.io/projected/dd9536b0-b583-49a9-b19d-1c36e2134a37-kube-api-access-tg84l\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091341 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-systemd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091419 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091433 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.091850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091435 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091445 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq8bd\" (UniqueName: \"kubernetes.io/projected/34a9cdb8-0210-4d64-b5df-e88b71831d9c-kube-api-access-wq8bd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091444 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-slash\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091342 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-binary-copy\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091498 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-system-cni-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091502 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091548 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/216976d1-3300-45da-9dd3-e019e573c5ee-hosts-file\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091583 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/338835f8-b011-4ae7-83ce-617622894a0e-host-slash\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091608 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-kubernetes\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091612 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/138625ed-563d-4553-9ef4-67e541c29dbd-serviceca\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091632 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-tuned\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091654 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-netns\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091656 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-run-systemd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091656 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-kubernetes\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091676 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-hostroot\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091701 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-socket-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091709 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-netns\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091721 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-hostroot\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.092687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091724 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-registration-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091744 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-multus-certs\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091749 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-kubelet-config\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091800 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-kubelet-config\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091808 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-socket-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091813 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-registration-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091870 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-dbus\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091896 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-systemd\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091925 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/216976d1-3300-45da-9dd3-e019e573c5ee-tmp-dir\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091941 2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091962 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-systemd\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091993 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.091944 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-dbus\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-system-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092060 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-cnibin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092081 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-kubelet\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092127 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqrm8\" (UniqueName: \"kubernetes.io/projected/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-kube-api-access-nqrm8\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092141 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-kubelet\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.093559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092165 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-cni-binary-copy\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092194 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-netns\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092198 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-cnibin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092213 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/216976d1-3300-45da-9dd3-e019e573c5ee-tmp-dir\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092240 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-netns\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092139 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-system-cni-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092235 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-conf-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092295 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-daemon-config\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092318 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092340 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092381 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659c5\" (UniqueName: \"kubernetes.io/projected/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kube-api-access-659c5\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092402 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-conf\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092424 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092432 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-run\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092461 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-config\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092473 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-conf-dir\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092489 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138625ed-563d-4553-9ef4-67e541c29dbd-host\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092516 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-socket-dir-parent\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.094411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092520 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-run\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092542 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-tmp\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092548 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092565 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/894742b2-7ee1-4566-a173-385f22ebd8ed-agent-certs\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092601 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092634 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-socket-dir-parent\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092639 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-device-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092667 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-host\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092694 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092721 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-conf\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092718 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-bin\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092752 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovn-node-metrics-cert\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092774 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092800 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74dx\" (UniqueName: \"kubernetes.io/projected/2226e368-5e76-43fc-82ee-e837bab7359d-kube-api-access-s74dx\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092839 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-cni-binary-copy\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092846 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-bin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092870 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092894 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-sys\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092902 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-cni-bin\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092918 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-var-lib-kubelet\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092941 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/138625ed-563d-4553-9ef4-67e541c29dbd-host\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092962 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-systemd-units\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092989 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-env-overrides\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093015 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovnkube-config\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093025 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-host\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093016 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.092990 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-device-dir\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093104 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-k8s-cni-cncf-io\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093127 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093149 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/338835f8-b011-4ae7-83ce-617622894a0e-iptables-alerter-script\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093179 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-cnibin\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093212 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysconfig\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093236 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-kubelet\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093262 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-var-lib-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.095700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093186 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093338 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-log-socket\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093434 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-log-socket\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093470 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-var-lib-openvswitch\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093553 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysctl-d\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093591 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-var-lib-kubelet\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093623 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-var-lib-cni-bin\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093650 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2226e368-5e76-43fc-82ee-e837bab7359d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093663 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-sys\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093702 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.093696 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-systemd-units\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094078 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a9cdb8-0210-4d64-b5df-e88b71831d9c-env-overrides\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094125 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd9536b0-b583-49a9-b19d-1c36e2134a37-host-run-k8s-cni-cncf-io\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094181 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/338835f8-b011-4ae7-83ce-617622894a0e-iptables-alerter-script\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.094190 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.094278 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:06:34.594261264 +0000 UTC m=+3.655112885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094334 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2226e368-5e76-43fc-82ee-e837bab7359d-cnibin\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.096169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094397 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-sysconfig\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094429 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a9cdb8-0210-4d64-b5df-e88b71831d9c-host-kubelet\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.094905 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd9536b0-b583-49a9-b19d-1c36e2134a37-multus-daemon-config\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.095279 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-etc-tuned\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.095345 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16dbcd49-0e31-4944-8957-5b1055c9315a-tmp\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.095564 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/894742b2-7ee1-4566-a173-385f22ebd8ed-agent-certs\") pod \"konnectivity-agent-2txw9\" (UID: \"894742b2-7ee1-4566-a173-385f22ebd8ed\") " pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:34.096654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.095579 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a9cdb8-0210-4d64-b5df-e88b71831d9c-ovn-node-metrics-cert\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.107838 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.107813 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftbmt\" (UniqueName: \"kubernetes.io/projected/216976d1-3300-45da-9dd3-e019e573c5ee-kube-api-access-ftbmt\") pod \"node-resolver-z4njp\" (UID: \"216976d1-3300-45da-9dd3-e019e573c5ee\") " pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.113133 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.113107 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz9lp\" (UniqueName: \"kubernetes.io/projected/138625ed-563d-4553-9ef4-67e541c29dbd-kube-api-access-mz9lp\") pod \"node-ca-wn8z5\" (UID: \"138625ed-563d-4553-9ef4-67e541c29dbd\") " pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.119160 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.119135 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z668t\" (UniqueName: \"kubernetes.io/projected/338835f8-b011-4ae7-83ce-617622894a0e-kube-api-access-z668t\") pod \"iptables-alerter-x4w49\" (UID: \"338835f8-b011-4ae7-83ce-617622894a0e\") " pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.126193 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqrm8\" (UniqueName: \"kubernetes.io/projected/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-kube-api-access-nqrm8\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.127084 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq8bd\" (UniqueName: \"kubernetes.io/projected/34a9cdb8-0210-4d64-b5df-e88b71831d9c-kube-api-access-wq8bd\") pod \"ovnkube-node-rgsp4\" (UID: \"34a9cdb8-0210-4d64-b5df-e88b71831d9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.127731 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.127760 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.127776 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.127856 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:34.627835296 +0000 UTC m=+3.688686917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:34.128735 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.128415 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74dx\" (UniqueName: \"kubernetes.io/projected/2226e368-5e76-43fc-82ee-e837bab7359d-kube-api-access-s74dx\") pod \"multus-additional-cni-plugins-lmdzn\" (UID: \"2226e368-5e76-43fc-82ee-e837bab7359d\") " pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.129454 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.129384 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-659c5\" (UniqueName: \"kubernetes.io/projected/6f20ad0a-7fb7-457e-a72f-e0aef1689a0e-kube-api-access-659c5\") pod \"aws-ebs-csi-driver-node-266xc\" (UID: \"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.130580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.130560 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg84l\" (UniqueName: \"kubernetes.io/projected/dd9536b0-b583-49a9-b19d-1c36e2134a37-kube-api-access-tg84l\") pod \"multus-lqm56\" (UID: \"dd9536b0-b583-49a9-b19d-1c36e2134a37\") " pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.132596 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.132573 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll4j7\" (UniqueName: \"kubernetes.io/projected/16dbcd49-0e31-4944-8957-5b1055c9315a-kube-api-access-ll4j7\") pod \"tuned-hv7gw\" (UID: \"16dbcd49-0e31-4944-8957-5b1055c9315a\") " pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.186373 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.186328 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b467e339b8d6495a764e5b20a26147.slice/crio-b7a72f78fa8c28ff8ef743620eb5c61bedc4f913faf95bd1af30c2f342b4c37d WatchSource:0}: Error finding container b7a72f78fa8c28ff8ef743620eb5c61bedc4f913faf95bd1af30c2f342b4c37d: Status 404 returned error can't find the container with id b7a72f78fa8c28ff8ef743620eb5c61bedc4f913faf95bd1af30c2f342b4c37d Sep 17 19:06:34.191567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.191550 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 19:06:34.206701 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.206645 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969ab8ad73131b876c88709692cad35c.slice/crio-73dab43ba809aac7efa48d60d38811007a608aa652fb0f80fcc018b15b62532a WatchSource:0}: Error finding container 73dab43ba809aac7efa48d60d38811007a608aa652fb0f80fcc018b15b62532a: Status 404 returned error can't find the container with id 73dab43ba809aac7efa48d60d38811007a608aa652fb0f80fcc018b15b62532a Sep 17 19:06:34.267701 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.267663 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4w49" Sep 17 19:06:34.275570 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.275540 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338835f8_b011_4ae7_83ce_617622894a0e.slice/crio-accbd14e04fa6f1c37e74f660078d7e404296663942946e422a5aeccfe87ea65 WatchSource:0}: Error finding container accbd14e04fa6f1c37e74f660078d7e404296663942946e422a5aeccfe87ea65: Status 404 returned error can't find the container with id accbd14e04fa6f1c37e74f660078d7e404296663942946e422a5aeccfe87ea65 Sep 17 19:06:34.280890 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.280870 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:06:34.288277 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.288253 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a9cdb8_0210_4d64_b5df_e88b71831d9c.slice/crio-1de3924bf9ca5354f9bd7345824afa90b752f14a0bf689d58baf670844d16e22 WatchSource:0}: Error finding container 1de3924bf9ca5354f9bd7345824afa90b752f14a0bf689d58baf670844d16e22: Status 404 returned error can't find the container with id 1de3924bf9ca5354f9bd7345824afa90b752f14a0bf689d58baf670844d16e22 Sep 17 19:06:34.299629 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.299606 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:34.307575 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.307549 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894742b2_7ee1_4566_a173_385f22ebd8ed.slice/crio-1227767476db72ee972a90f173f837e51abd5e81d22292ec2f82b1bbe93679ea WatchSource:0}: Error finding container 1227767476db72ee972a90f173f837e51abd5e81d22292ec2f82b1bbe93679ea: Status 404 returned error can't find the container with id 1227767476db72ee972a90f173f837e51abd5e81d22292ec2f82b1bbe93679ea Sep 17 19:06:34.313901 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.313880 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" Sep 17 19:06:34.320831 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.320776 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f20ad0a_7fb7_457e_a72f_e0aef1689a0e.slice/crio-5be936ba967ea80a3925294a8e4b89e593486144cf6aeeaeddf8d1a0d8149ac6 WatchSource:0}: Error finding container 5be936ba967ea80a3925294a8e4b89e593486144cf6aeeaeddf8d1a0d8149ac6: Status 404 returned error can't find the container with id 5be936ba967ea80a3925294a8e4b89e593486144cf6aeeaeddf8d1a0d8149ac6 Sep 17 19:06:34.332997 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.332979 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4njp" Sep 17 19:06:34.340817 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.340781 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216976d1_3300_45da_9dd3_e019e573c5ee.slice/crio-ac64ed7420c10dab453191350167d283e2ffdb87533632d8ea9c9a3ef1fa52ed WatchSource:0}: Error finding container ac64ed7420c10dab453191350167d283e2ffdb87533632d8ea9c9a3ef1fa52ed: Status 404 returned error can't find the container with id ac64ed7420c10dab453191350167d283e2ffdb87533632d8ea9c9a3ef1fa52ed Sep 17 19:06:34.346628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.346608 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wn8z5" Sep 17 19:06:34.353475 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.353452 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138625ed_563d_4553_9ef4_67e541c29dbd.slice/crio-ff41e1103f1f8fa8d301da86c5540d6081e6ef6158575935c43af8c416696f8a WatchSource:0}: Error finding container ff41e1103f1f8fa8d301da86c5540d6081e6ef6158575935c43af8c416696f8a: Status 404 returned error can't find the container with id ff41e1103f1f8fa8d301da86c5540d6081e6ef6158575935c43af8c416696f8a Sep 17 19:06:34.372470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.372438 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" Sep 17 19:06:34.378250 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.378228 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" Sep 17 19:06:34.379511 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.379485 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2226e368_5e76_43fc_82ee_e837bab7359d.slice/crio-11c5d95de4794bedcef52b57a65d906a7db83647c5295f2a7f788d20848b66ad WatchSource:0}: Error finding container 11c5d95de4794bedcef52b57a65d906a7db83647c5295f2a7f788d20848b66ad: Status 404 returned error can't find the container with id 11c5d95de4794bedcef52b57a65d906a7db83647c5295f2a7f788d20848b66ad Sep 17 19:06:34.382597 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.382580 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lqm56" Sep 17 19:06:34.390631 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:06:34.390609 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9536b0_b583_49a9_b19d_1c36e2134a37.slice/crio-21d6d5382de95d0bd3d219237bee8c63ea697486aae39679872c44825f245ede WatchSource:0}: Error finding container 21d6d5382de95d0bd3d219237bee8c63ea697486aae39679872c44825f245ede: Status 404 returned error can't find the container with id 21d6d5382de95d0bd3d219237bee8c63ea697486aae39679872c44825f245ede Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.597511 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.597583 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.597638 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.597707 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.597717 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:06:35.597697192 +0000 UTC m=+4.658548817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:34.597846 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.597760 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:06:35.597744929 +0000 UTC m=+4.658596536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:34.698325 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:34.698280 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:34.698574 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.698504 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:34.698574 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.698534 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:34.698574 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.698547 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:34.698742 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:34.698612 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:35.698592064 +0000 UTC m=+4.759443677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:35.042127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.042031 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 19:01:34 +0000 UTC" deadline="2028-04-04 06:16:15.480362234 +0000 UTC" Sep 17 19:06:35.042127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.042078 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13547h9m40.438288337s" Sep 17 19:06:35.138547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.138481 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn8z5" event={"ID":"138625ed-563d-4553-9ef4-67e541c29dbd","Type":"ContainerStarted","Data":"ff41e1103f1f8fa8d301da86c5540d6081e6ef6158575935c43af8c416696f8a"} Sep 17 19:06:35.143637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.143602 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4njp" event={"ID":"216976d1-3300-45da-9dd3-e019e573c5ee","Type":"ContainerStarted","Data":"ac64ed7420c10dab453191350167d283e2ffdb87533632d8ea9c9a3ef1fa52ed"} Sep 17 19:06:35.149965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.149928 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" event={"ID":"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e","Type":"ContainerStarted","Data":"5be936ba967ea80a3925294a8e4b89e593486144cf6aeeaeddf8d1a0d8149ac6"} Sep 17 19:06:35.151610 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.151588 2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:35.154335 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.154307 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4w49" event={"ID":"338835f8-b011-4ae7-83ce-617622894a0e","Type":"ContainerStarted","Data":"accbd14e04fa6f1c37e74f660078d7e404296663942946e422a5aeccfe87ea65"} Sep 17 19:06:35.158655 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.158587 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"969ab8ad73131b876c88709692cad35c","Type":"ContainerStarted","Data":"73dab43ba809aac7efa48d60d38811007a608aa652fb0f80fcc018b15b62532a"} Sep 17 19:06:35.167168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.167130 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2txw9" event={"ID":"894742b2-7ee1-4566-a173-385f22ebd8ed","Type":"ContainerStarted","Data":"1227767476db72ee972a90f173f837e51abd5e81d22292ec2f82b1bbe93679ea"} Sep 17 19:06:35.197274 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.197234 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"1de3924bf9ca5354f9bd7345824afa90b752f14a0bf689d58baf670844d16e22"} Sep 17 19:06:35.205811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.205773 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" event={"ID":"96b467e339b8d6495a764e5b20a26147","Type":"ContainerStarted","Data":"b7a72f78fa8c28ff8ef743620eb5c61bedc4f913faf95bd1af30c2f342b4c37d"} Sep 17 19:06:35.213755 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.213716 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lqm56" event={"ID":"dd9536b0-b583-49a9-b19d-1c36e2134a37","Type":"ContainerStarted","Data":"21d6d5382de95d0bd3d219237bee8c63ea697486aae39679872c44825f245ede"} Sep 17 19:06:35.225700 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.225666 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" event={"ID":"16dbcd49-0e31-4944-8957-5b1055c9315a","Type":"ContainerStarted","Data":"836f84754645e68770408d92c4767abd95d4cf41e5f0789d98b6bdb91bac77a8"} Sep 17 19:06:35.229654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.229621 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerStarted","Data":"11c5d95de4794bedcef52b57a65d906a7db83647c5295f2a7f788d20848b66ad"} Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.606010 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.606089 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.606223 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.606285 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:06:37.606267702 +0000 UTC m=+6.667119331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.606750 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:35.606839 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.606805 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:06:37.606789638 +0000 UTC m=+6.667641249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:35.706511 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:35.706472 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:35.706693 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.706675 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:35.706770 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.706696 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:35.706770 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.706710 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:35.706770 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:35.706768 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:37.706750924 +0000 UTC m=+6.767602531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:36.043060 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.042941 2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 19:01:34 +0000 UTC" deadline="2028-06-25 10:15:21.31285442 +0000 UTC" Sep 17 19:06:36.043060 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.043008 2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15519h8m45.269850883s" Sep 17 19:06:36.117338 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.117307 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:36.117532 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:36.117456 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:36.118339 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.117877 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:36.118339 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:36.117981 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:36.118339 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.118040 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:36.118339 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:36.118109 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:36.288688 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:36.288436 2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 19:06:37.624505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:37.624462 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:37.625011 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:37.624542 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:37.625011 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.624689 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:37.625011 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.624764 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:06:41.624746284 +0000 UTC m=+10.685597895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:37.625220 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.625173 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:37.625278 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.625226 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:06:41.625208389 +0000 UTC m=+10.686060037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:37.725796 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:37.725742 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:37.726061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.725927 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:37.726061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.725952 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:37.726061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.725961 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:37.726061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:37.726019 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:41.726001302 +0000 UTC m=+10.786852931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:38.118046 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:38.118073 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:38.118055 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:38.118178 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:38.118282 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:38.118613 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:38.118391 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:40.117541 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:40.117499 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:40.118061 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:40.117541 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:40.118061 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:40.117499 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:40.118061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:40.117650 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:40.118061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:40.117770 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:40.118061 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:40.117840 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:41.661781 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:41.661861 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.661990 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.662052 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:06:49.662033853 +0000 UTC m=+18.722885476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.662127 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:41.662407 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.662195 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:06:49.662178427 +0000 UTC m=+18.723030049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:41.762730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:41.762688 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:41.763012 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.762908 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:41.763012 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.762936 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:41.763012 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.762952 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:41.763012 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:41.763010 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:06:49.762991622 +0000 UTC m=+18.823843250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:42.117299 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:42.117262 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:42.117495 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:42.117265 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:42.117495 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:42.117406 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:42.117495 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:42.117275 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:42.117495 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:42.117478 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:42.117691 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:42.117542 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:44.117853 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:44.117758 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:44.118334 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:44.117885 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:44.118334 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:44.117970 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:44.118334 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:44.118071 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:44.118334 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:44.118125 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:44.118334 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:44.118203 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:46.118186 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:46.118140 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:46.118658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:46.118190 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:46.118658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:46.118194 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:46.118658 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:46.118290 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:46.118658 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:46.118422 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:46.118658 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:46.118537 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:48.117396 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:48.117339 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:48.117860 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:48.117347 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:48.117860 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:48.117508 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:48.117860 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:48.117521 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:48.117860 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:48.117628 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:48.117860 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:48.117720 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:49.722222 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:49.722192 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:49.722628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:49.722249 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:49.722628 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.722342 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:49.722628 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.722361 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:49.722628 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.722416 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.722401728 +0000 UTC m=+34.783253333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:06:49.722628 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.722433 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.722423954 +0000 UTC m=+34.783275560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:06:49.823131 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:49.823093 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:49.823304 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.823231 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:06:49.823304 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.823246 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:06:49.823304 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.823254 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:49.823462 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:49.823308 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:05.823292421 +0000 UTC m=+34.884144043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:06:50.117746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:50.117706 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:50.117979 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:50.117754 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:50.117979 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:50.117712 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:50.117979 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:50.117843 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:50.117979 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:50.117921 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:50.118156 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:50.118018 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:52.117485 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:52.117449 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:52.117952 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:52.117591 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:52.117952 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:52.117608 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:52.117952 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:52.117707 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:52.117952 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:52.117763 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:52.117952 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:52.117825 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:53.271484 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.271221 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" event={"ID":"96b467e339b8d6495a764e5b20a26147","Type":"ContainerStarted","Data":"431da8624801afc85e524927ab4e99c9fb59e4623a47428a753d3a462e8b766a"} Sep 17 19:06:53.272930 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.272895 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lqm56" event={"ID":"dd9536b0-b583-49a9-b19d-1c36e2134a37","Type":"ContainerStarted","Data":"96afd61f141e6978908e071e44cdc0a10fd208b91987204f0f15d9936fc00f4b"} Sep 17 19:06:53.276671 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.276642 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" event={"ID":"16dbcd49-0e31-4944-8957-5b1055c9315a","Type":"ContainerStarted","Data":"b64208ba014e8daabc9d970470d65e90cc10709490348a8e00002d7d7f16e96d"} Sep 17 19:06:53.289170 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.289122 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-216.ec2.internal" podStartSLOduration=20.289109097 podStartE2EDuration="20.289109097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:53.288737402 +0000 UTC m=+22.349589030" watchObservedRunningTime="2026-09-17 19:06:53.289109097 +0000 UTC m=+22.349960725" Sep 17 19:06:53.306956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.306905 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hv7gw" podStartSLOduration=1.8424151819999999 podStartE2EDuration="20.306889886s" totalImagesPullingTime="18.464474704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:53.306688127 +0000 UTC m=+22.367539755" watchObservedRunningTime="2026-09-17 19:06:53.306889886 +0000 UTC m=+22.367741514" Sep 17 19:06:53.328371 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:53.328292 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lqm56" podStartSLOduration=1.8338810620000001 podStartE2EDuration="20.328270429s" totalImagesPullingTime="18.494389367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:53.327648449 +0000 UTC m=+22.388500077" watchObservedRunningTime="2026-09-17 19:06:53.328270429 +0000 UTC m=+22.389122058" Sep 17 19:06:54.118233 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.117931 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:54.118417 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.117943 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:54.118417 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:54.118262 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:54.118417 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.117984 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:54.118417 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:54.118383 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:54.118631 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:54.118476 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:54.280694 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.280628 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2txw9" event={"ID":"894742b2-7ee1-4566-a173-385f22ebd8ed","Type":"ContainerStarted","Data":"2bcdbdce12bbf5c7f1728ba337e0552e3499fc1657e4de36789a5d3d2726c371"} Sep 17 19:06:54.283588 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283564 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"5e06ddb6e0bcf9431f8c325dafcf1b604dca6f364f8e142930a5efd82d6f479b"} Sep 17 19:06:54.283701 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283628 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"949358f03a860432cac2be037752ce88998054835dc8159462ba873c5c785425"} Sep 17 19:06:54.283701 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283670 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"30c080d1a2fa88349ca08aa16bcf65c2d73dbd54f10809a647e4bb7928ad0126"} Sep 17 19:06:54.283701 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283699 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"cd787d3bfc209ddfe633795f1e3e54316803d2de3404589020e690c4f4f343ec"} Sep 17 19:06:54.283862 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283725 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"20b1a2b0f0751b5d6a3d3171315c04000a4c623dc2348c10a6e80eedcce5065e"} Sep 17 19:06:54.283862 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.283760 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"e035ff722bba37706aac53db1aabc8414b30035ee157175bed1a747c9a8ddd5c"} Sep 17 19:06:54.285040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.285017 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="2e31108ad29bc639b77caca26f5232a2a2e2a61a21b2b52c2344f2a44ab05401" exitCode=0 Sep 17 19:06:54.285139 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.285097 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"2e31108ad29bc639b77caca26f5232a2a2e2a61a21b2b52c2344f2a44ab05401"} Sep 17 19:06:54.286917 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.286758 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wn8z5" event={"ID":"138625ed-563d-4553-9ef4-67e541c29dbd","Type":"ContainerStarted","Data":"bdf973ec2f1b5a1c516b5ef4593f428ba3d6073a03e34ed47e6f6043fa5e7935"} Sep 17 19:06:54.289142 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.289092 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4njp" event={"ID":"216976d1-3300-45da-9dd3-e019e573c5ee","Type":"ContainerStarted","Data":"07d95d7e038df63d338bbc10f74f195fdeea92fdaef1168a8d477fb8bc1d038b"} Sep 17 19:06:54.291007 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.290983 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" event={"ID":"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e","Type":"ContainerStarted","Data":"c4f66cbd8b3dd42039b791b71740297c0c0d1c898207a8d2359a3ae677fbf15b"} Sep 17 19:06:54.292784 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.292762 2588 generic.go:356] "Generic (PLEG): container finished" podID="969ab8ad73131b876c88709692cad35c" containerID="2e8814b0ab8907d220dacddabeb0679fe44ade516ff59d76c07ffe13984c7397" exitCode=0 Sep 17 19:06:54.292885 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.292820 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"969ab8ad73131b876c88709692cad35c","Type":"ContainerDied","Data":"2e8814b0ab8907d220dacddabeb0679fe44ade516ff59d76c07ffe13984c7397"} Sep 17 19:06:54.310922 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.310878 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2txw9" podStartSLOduration=2.770679887 podStartE2EDuration="21.310863362s" totalImagesPullingTime="18.540183475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:54.310281571 +0000 UTC m=+23.371133199" watchObservedRunningTime="2026-09-17 19:06:54.310863362 +0000 UTC m=+23.371714989" Sep 17 19:06:54.369398 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.369129 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:54.384886 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.384834 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4njp" podStartSLOduration=2.877894488 podStartE2EDuration="21.384811853s" totalImagesPullingTime="18.506917365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:54.354897783 +0000 UTC m=+23.415749413" watchObservedRunningTime="2026-09-17 19:06:54.384811853 +0000 UTC m=+23.445663480" Sep 17 19:06:54.385055 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.384928 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wn8z5" podStartSLOduration=2.890502733 podStartE2EDuration="21.384920907s" totalImagesPullingTime="18.494418174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:54.384896495 +0000 UTC m=+23.445748127" watchObservedRunningTime="2026-09-17 19:06:54.384920907 +0000 UTC m=+23.445772535" Sep 17 19:06:54.600493 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.600455 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:54.691553 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.691498 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:54.720543 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.720518 2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 19:06:54.833221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.833181 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:54.921534 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:54.921452 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:55.024099 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.024058 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:55.087413 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.087275 2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T19:06:54.720540021Z","UUID":"f94b2209-cf97-4d8e-85eb-460c0c747b76","Handler":null,"Name":"","Endpoint":""} Sep 17 19:06:55.088932 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.088911 2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 19:06:55.089064 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.088943 2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 19:06:55.296584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.296548 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:55.298747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.298722 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" event={"ID":"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e","Type":"ContainerStarted","Data":"60df93a5fb7c9a3c8bdc8537c2f9c1c0b40e0f37d883b967c5c253bb538f7497"} Sep 17 19:06:55.300526 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.300492 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4w49" event={"ID":"338835f8-b011-4ae7-83ce-617622894a0e","Type":"ContainerStarted","Data":"db3664b51b86c37a547d3d061d108595a51aa51d7e31702f86610e32f8e0cf2d"} Sep 17 19:06:55.302803 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.302775 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" event={"ID":"969ab8ad73131b876c88709692cad35c","Type":"ContainerStarted","Data":"ebb1f7ea86b3c435dce00b48ed3d739a65d1ab7faab68946838c9259bd556bbf"} Sep 17 19:06:55.319968 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.319904 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x4w49" podStartSLOduration=3.747613703 podStartE2EDuration="22.319886383s" totalImagesPullingTime="18.57227268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:55.319541115 +0000 UTC m=+24.380392743" watchObservedRunningTime="2026-09-17 19:06:55.319886383 +0000 UTC m=+24.380738013" Sep 17 19:06:55.346083 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.346028 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-216.ec2.internal" podStartSLOduration=22.34601237 podStartE2EDuration="22.34601237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:55.345726944 +0000 UTC m=+24.406578575" watchObservedRunningTime="2026-09-17 19:06:55.34601237 +0000 UTC m=+24.406863999" Sep 17 19:06:55.397917 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.397855 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:55.499854 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.499819 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:55.564195 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.564123 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4njp_216976d1-3300-45da-9dd3-e019e573c5ee/dns-node-resolver/0.log" Sep 17 19:06:55.599805 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:55.599774 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:56.117260 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.117234 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:56.117260 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.117259 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:56.117447 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.117373 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:56.117447 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:56.117373 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:56.117447 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:56.117437 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:56.117591 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:56.117510 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:56.307795 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.307738 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" event={"ID":"6f20ad0a-7fb7-457e-a72f-e0aef1689a0e","Type":"ContainerStarted","Data":"953f3c4bce978d948897295f78d9fbed1c83c0fbb793a4f2b27171597e22dbe2"} Sep 17 19:06:56.311972 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.311943 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"ae1b5d5786cc0baf891200ef18769d43e5d55ccf50e0260f63e8362edeac4234"} Sep 17 19:06:56.334238 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.334186 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-266xc" podStartSLOduration=2.828472617 podStartE2EDuration="23.334171787s" totalImagesPullingTime="20.50569917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:56.334153349 +0000 UTC m=+25.395004976" watchObservedRunningTime="2026-09-17 19:06:56.334171787 +0000 UTC m=+25.395023415" Sep 17 19:06:56.566254 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.566223 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn8z5_138625ed-563d-4553-9ef4-67e541c29dbd/node-ca/0.log" Sep 17 19:06:56.919609 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.919528 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:56.997616 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:56.997578 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:57.620676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:57.620643 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:57.700463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:57.700424 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:58.049321 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.049289 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:58.117402 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.117367 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:06:58.117402 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.117391 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:06:58.117661 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:58.117507 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:06:58.117661 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.117519 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:06:58.117661 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:58.117584 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:06:58.117661 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:06:58.117656 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:06:58.824739 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.824570 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:58.912189 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:58.912154 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:59.011452 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.011368 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:59.011925 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.011904 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:59.015855 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.015815 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:59.111947 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.111913 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:59.181515 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.181469 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:06:59.321771 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.321683 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="cadc5ada87ca1d0307875510f5eb7f7d2fa2a09c96f4e4be3ef5d1efcdad2f89" exitCode=0 Sep 17 19:06:59.321771 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.321745 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"cadc5ada87ca1d0307875510f5eb7f7d2fa2a09c96f4e4be3ef5d1efcdad2f89"} Sep 17 19:06:59.327506 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.327478 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" event={"ID":"34a9cdb8-0210-4d64-b5df-e88b71831d9c","Type":"ContainerStarted","Data":"9aefc50612de337f358904297a3f8fd2488ad5b12ea161659d41eb00338653b4"} Sep 17 19:06:59.327908 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.327885 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:59.328200 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.328184 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2txw9" Sep 17 19:06:59.402709 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.402658 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" podStartSLOduration=7.345087681 podStartE2EDuration="26.402642144s" totalImagesPullingTime="19.057554463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:06:59.402467093 +0000 UTC m=+28.463318720" watchObservedRunningTime="2026-09-17 19:06:59.402642144 +0000 UTC m=+28.463493771" Sep 17 19:06:59.680411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:06:59.680327 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:00.117598 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.117565 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:00.118262 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.117667 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:00.118262 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:00.117682 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:00.118262 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.117697 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:00.118262 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:00.117771 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:00.118262 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:00.117865 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:00.278723 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.278684 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:00.332117 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.332077 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="f7511994d324f10ceda0687a95d8ccecdcfe1de2562d95def24f1b2426a69a14" exitCode=0 Sep 17 19:07:00.332246 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.332156 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"f7511994d324f10ceda0687a95d8ccecdcfe1de2562d95def24f1b2426a69a14"} Sep 17 19:07:00.333243 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.332849 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:00.333243 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.332916 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:00.333243 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.332962 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:00.347932 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.347908 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:00.348064 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.348010 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:00.751962 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.751934 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:00.855123 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.855089 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:00.951653 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:00.951617 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:01.061231 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:01.061196 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:01.282905 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:01.282810 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:01.336960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:01.336932 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="269f41191b33563c4c839df668ddae97098a1ca20252d3872677e6cd8d0ead84" exitCode=0 Sep 17 19:07:01.337110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:01.337022 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"269f41191b33563c4c839df668ddae97098a1ca20252d3872677e6cd8d0ead84"} Sep 17 19:07:01.466503 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:01.466468 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:02.023451 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.023415 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:02.118094 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.118059 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:02.118281 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.118058 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:02.118281 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:02.118217 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:02.118420 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.118302 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:02.118475 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:02.118429 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:02.118531 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:02.118516 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:02.458169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.458061 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:02.537793 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.537757 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:02.610771 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.610733 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:02.843653 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:02.843621 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:03.058555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:03.058462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:03.246578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:03.246541 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:03.455044 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:03.455013 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:04.118200 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.118162 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:04.118747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.118162 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:04.118747 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:04.118310 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:04.118747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.118162 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:04.118747 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:04.118363 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:04.118747 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:04.118468 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:04.452870 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.452784 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:04.767557 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.767490 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:04.870502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:04.870466 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:05.042768 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.042683 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:05.238148 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.238113 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:05.646299 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.646256 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:05.741163 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.741126 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:05.741313 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.741183 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:05.741313 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.741266 2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:07:05.741313 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.741282 2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 19:07:05.741448 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.741331 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs podName:e4a2299a-b3d7-43bc-a83d-e63be8e7584f nodeName:}" failed. No retries permitted until 2026-09-17 19:07:37.74131569 +0000 UTC m=+66.802167296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs") pod "network-metrics-daemon-82nmg" (UID: "e4a2299a-b3d7-43bc-a83d-e63be8e7584f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 19:07:05.741448 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.741346 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret podName:aae7adca-d307-4fd3-9a3c-8fa1bfe1951c nodeName:}" failed. No retries permitted until 2026-09-17 19:07:37.741339471 +0000 UTC m=+66.802191077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret") pod "global-pull-secret-syncer-fdzrj" (UID: "aae7adca-d307-4fd3-9a3c-8fa1bfe1951c") : object "kube-system"/"original-pull-secret" not registered Sep 17 19:07:05.842262 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:05.842227 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:05.842454 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.842372 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 19:07:05.842454 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.842389 2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 19:07:05.842454 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.842397 2588 projected.go:196] Error preparing data for projected volume kube-api-access-dwkf8 for pod openshift-network-diagnostics/network-check-target-kftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:07:05.842454 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:05.842443 2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8 podName:4b51ccdf-4892-4ca4-8339-cf93ba802a78 nodeName:}" failed. No retries permitted until 2026-09-17 19:07:37.842429486 +0000 UTC m=+66.903281092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dwkf8" (UniqueName: "kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8") pod "network-check-target-kftjw" (UID: "4b51ccdf-4892-4ca4-8339-cf93ba802a78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 19:07:06.117547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.117520 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:06.117701 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.117520 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:06.117701 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:06.117659 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:06.117821 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.117515 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:06.117821 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:06.117743 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:06.117821 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:06.117772 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:06.245828 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.245803 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:06.352839 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.352812 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="c67d684a621edefb08bec40204243b35ff816db7e9b5e06ecb9108b5c26070a8" exitCode=0 Sep 17 19:07:06.352993 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.352867 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"c67d684a621edefb08bec40204243b35ff816db7e9b5e06ecb9108b5c26070a8"} Sep 17 19:07:06.654165 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:06.654120 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:07.037613 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:07.037578 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:07.358234 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:07.358152 2588 generic.go:356] "Generic (PLEG): container finished" podID="2226e368-5e76-43fc-82ee-e837bab7359d" containerID="e06d2bd7332320d5ea0bbcee2d9ac397f2f8c88a7a6654f351452a563fdff3d2" exitCode=0 Sep 17 19:07:07.358234 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:07.358214 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerDied","Data":"e06d2bd7332320d5ea0bbcee2d9ac397f2f8c88a7a6654f351452a563fdff3d2"} Sep 17 19:07:07.443486 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:07.443245 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:07.649851 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:07.649736 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:08.040579 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.040552 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:08.117431 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.117390 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:08.117600 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.117432 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:08.117600 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.117396 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:08.117600 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:08.117531 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:08.117600 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:08.117587 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:08.117757 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:08.117701 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:08.365891 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.365797 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" event={"ID":"2226e368-5e76-43fc-82ee-e837bab7359d","Type":"ContainerStarted","Data":"81283a5a3580c7936f8b311081d0ca22f3e679ca03c6bd1ae4ea0a0b243d276f"} Sep 17 19:07:08.394785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.394733 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lmdzn" podStartSLOduration=6.5334135490000005 podStartE2EDuration="35.394717201s" totalImagesPullingTime="28.861303652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:08.393267404 +0000 UTC m=+37.454119032" watchObservedRunningTime="2026-09-17 19:07:08.394717201 +0000 UTC m=+37.455568828" Sep 17 19:07:08.461159 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:08.461123 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:09.095423 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:09.095391 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:09.279252 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:09.279220 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:09.465082 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:09.464986 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:10.117914 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:10.117879 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:10.117914 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:10.117913 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:10.118188 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:10.117879 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:10.118188 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:10.117978 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:10.118188 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:10.118072 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:10.118188 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:10.118152 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:10.182584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:10.182552 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:11.783738 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:11.783691 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:11.879929 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:11.879901 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:12.117756 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:12.117674 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:12.117921 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:12.117813 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:12.117921 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:12.117862 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:12.118408 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:12.118327 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:12.118408 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:12.118339 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:12.118622 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:12.118486 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:13.604736 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:13.604702 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:13.684344 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:13.684308 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:14.117159 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:14.117122 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:14.117346 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:14.117176 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:14.117346 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:14.117127 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:14.117346 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:14.117245 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:14.117346 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:14.117309 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:14.117539 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:14.117401 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:16.117692 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:16.117661 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:16.118125 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:16.117665 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:16.118125 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:16.117762 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:16.118125 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:16.117665 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:16.118125 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:16.117843 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:16.118125 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:16.117908 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:18.117901 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.117865 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:18.118395 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:18.117969 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:18.118395 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.117865 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:18.118395 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.117865 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:18.118395 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:18.118056 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:18.118395 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:18.118113 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:18.532064 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.532033 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:18.677237 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.677205 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:18.790639 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.790556 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:18.974516 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:18.974483 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:19.119779 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.119693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:19.210972 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.210940 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:19.281492 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.281456 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:19.694641 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.694610 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdzrj"] Sep 17 19:07:19.694782 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.694736 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:19.694872 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:19.694851 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:19.697711 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.697678 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kftjw"] Sep 17 19:07:19.697853 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.697775 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:19.697908 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:19.697862 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:19.698332 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.698309 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82nmg"] Sep 17 19:07:19.698477 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:19.698427 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:19.698555 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:19.698530 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:20.463150 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:20.463097 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:20.562048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:20.562017 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:20.670224 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:20.670191 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:21.117630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.117598 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:21.117876 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.117598 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:21.117876 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:21.117702 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:21.117876 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:21.117790 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:21.117876 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.117605 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:21.117876 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:21.117858 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:21.517861 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.517819 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:21.763014 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.762975 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:21.855836 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.855737 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:21.924467 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:21.924433 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:22.203671 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:22.203578 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:23.118800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:23.118763 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:23.119289 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:23.118858 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82nmg" podUID="e4a2299a-b3d7-43bc-a83d-e63be8e7584f" Sep 17 19:07:23.119289 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:23.118874 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:23.119289 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:23.118995 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kftjw" podUID="4b51ccdf-4892-4ca4-8339-cf93ba802a78" Sep 17 19:07:23.119289 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:23.119010 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:23.119289 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:07:23.119079 2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdzrj" podUID="aae7adca-d307-4fd3-9a3c-8fa1bfe1951c" Sep 17 19:07:24.111558 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.111384 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:24.184911 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.184883 2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-216.ec2.internal" event="NodeReady" Sep 17 19:07:24.185407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.185000 2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 19:07:24.235896 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.235865 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:24.257760 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.257722 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5h5w6"] Sep 17 19:07:24.259894 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.259878 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.266065 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266005 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 19:07:24.266395 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266094 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 19:07:24.266493 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266418 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 19:07:24.266493 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266433 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ftw2s\"" Sep 17 19:07:24.266771 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266753 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 19:07:24.267396 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.266935 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xwldz"] Sep 17 19:07:24.269038 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.269018 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.271794 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.271772 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 19:07:24.271890 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.271820 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 19:07:24.272022 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.272008 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mr5fs\"" Sep 17 19:07:24.287137 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.287098 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5h5w6"] Sep 17 19:07:24.287800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.287776 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xwldz"] Sep 17 19:07:24.300722 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.300695 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-76rz2"] Sep 17 19:07:24.302595 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.302580 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.305477 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.305455 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 19:07:24.305591 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.305464 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 19:07:24.305664 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.305641 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 19:07:24.305718 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.305683 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4z8hc\"" Sep 17 19:07:24.318201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.318171 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76rz2"] Sep 17 19:07:24.334883 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.334837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:24.363082 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363000 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.363082 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363035 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd6ks\" (UniqueName: \"kubernetes.io/projected/b338c7d1-81e0-4c88-8611-e776bbe40fb6-kube-api-access-nd6ks\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.363082 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363058 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpw4\" (UniqueName: \"kubernetes.io/projected/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-api-access-4xpw4\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363148 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601abfe7-c77a-4d28-8447-907985bb4cc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363179 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b338c7d1-81e0-4c88-8611-e776bbe40fb6-tmp-dir\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363209 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601abfe7-c77a-4d28-8447-907985bb4cc6-data-volume\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363244 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601abfe7-c77a-4d28-8447-907985bb4cc6-crio-socket\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363261 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b338c7d1-81e0-4c88-8611-e776bbe40fb6-metrics-tls\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.363291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.363281 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b338c7d1-81e0-4c88-8611-e776bbe40fb6-config-volume\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464038 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464001 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7ce6f2e-667e-48c4-be32-514b826ecd1a-cert\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.464038 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464046 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601abfe7-c77a-4d28-8447-907985bb4cc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464280 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464065 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b338c7d1-81e0-4c88-8611-e776bbe40fb6-tmp-dir\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464280 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464099 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601abfe7-c77a-4d28-8447-907985bb4cc6-data-volume\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464280 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464202 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601abfe7-c77a-4d28-8447-907985bb4cc6-crio-socket\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464280 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464240 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b338c7d1-81e0-4c88-8611-e776bbe40fb6-metrics-tls\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464402 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b338c7d1-81e0-4c88-8611-e776bbe40fb6-config-volume\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464427 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601abfe7-c77a-4d28-8447-907985bb4cc6-crio-socket\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464444 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464489 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd6ks\" (UniqueName: \"kubernetes.io/projected/b338c7d1-81e0-4c88-8611-e776bbe40fb6-kube-api-access-nd6ks\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464500 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601abfe7-c77a-4d28-8447-907985bb4cc6-data-volume\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.464776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464519 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n277g\" (UniqueName: \"kubernetes.io/projected/c7ce6f2e-667e-48c4-be32-514b826ecd1a-kube-api-access-n277g\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.464776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464500 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b338c7d1-81e0-4c88-8611-e776bbe40fb6-tmp-dir\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.464776 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.464574 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpw4\" (UniqueName: \"kubernetes.io/projected/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-api-access-4xpw4\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.465022 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.465002 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b338c7d1-81e0-4c88-8611-e776bbe40fb6-config-volume\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.465059 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.465002 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.469160 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.469142 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b338c7d1-81e0-4c88-8611-e776bbe40fb6-metrics-tls\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.469226 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.469180 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601abfe7-c77a-4d28-8447-907985bb4cc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.486481 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.486448 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpw4\" (UniqueName: \"kubernetes.io/projected/601abfe7-c77a-4d28-8447-907985bb4cc6-kube-api-access-4xpw4\") pod \"insights-runtime-extractor-5h5w6\" (UID: \"601abfe7-c77a-4d28-8447-907985bb4cc6\") " pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.489143 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.489118 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd6ks\" (UniqueName: \"kubernetes.io/projected/b338c7d1-81e0-4c88-8611-e776bbe40fb6-kube-api-access-nd6ks\") pod \"dns-default-xwldz\" (UID: \"b338c7d1-81e0-4c88-8611-e776bbe40fb6\") " pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.565020 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.564985 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7ce6f2e-667e-48c4-be32-514b826ecd1a-cert\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.565222 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.565078 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n277g\" (UniqueName: \"kubernetes.io/projected/c7ce6f2e-667e-48c4-be32-514b826ecd1a-kube-api-access-n277g\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.565747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.565716 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:24.567598 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.567579 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7ce6f2e-667e-48c4-be32-514b826ecd1a-cert\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.569412 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.569389 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5h5w6" Sep 17 19:07:24.574546 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.574529 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n277g\" (UniqueName: \"kubernetes.io/projected/c7ce6f2e-667e-48c4-be32-514b826ecd1a-kube-api-access-n277g\") pod \"ingress-canary-76rz2\" (UID: \"c7ce6f2e-667e-48c4-be32-514b826ecd1a\") " pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.577346 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.577329 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:24.611001 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.610962 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-76rz2" Sep 17 19:07:24.708010 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.707973 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:24.874971 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.874887 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xwldz"] Sep 17 19:07:24.877541 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.877516 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5h5w6"] Sep 17 19:07:24.879665 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:24.879637 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb338c7d1_81e0_4c88_8611_e776bbe40fb6.slice/crio-6cbf6eebb4d11abd827181f651f699f2670aed6653789a27febf9ea8accbeaa2 WatchSource:0}: Error finding container 6cbf6eebb4d11abd827181f651f699f2670aed6653789a27febf9ea8accbeaa2: Status 404 returned error can't find the container with id 6cbf6eebb4d11abd827181f651f699f2670aed6653789a27febf9ea8accbeaa2 Sep 17 19:07:24.881495 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:24.881472 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601abfe7_c77a_4d28_8447_907985bb4cc6.slice/crio-a95829f7fcff8255f5e444ea938dbcfc63a9da3a1b88d28e29a5492f4a49e515 WatchSource:0}: Error finding container a95829f7fcff8255f5e444ea938dbcfc63a9da3a1b88d28e29a5492f4a49e515: Status 404 returned error can't find the container with id a95829f7fcff8255f5e444ea938dbcfc63a9da3a1b88d28e29a5492f4a49e515 Sep 17 19:07:24.900615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:24.900577 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-76rz2"] Sep 17 19:07:24.909710 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:24.909684 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ce6f2e_667e_48c4_be32_514b826ecd1a.slice/crio-5c323f0f04c984d581d3e3e028938c92656e3ed1a369189ffd0a08955b5796cf WatchSource:0}: Error finding container 5c323f0f04c984d581d3e3e028938c92656e3ed1a369189ffd0a08955b5796cf: Status 404 returned error can't find the container with id 5c323f0f04c984d581d3e3e028938c92656e3ed1a369189ffd0a08955b5796cf Sep 17 19:07:25.117518 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.117255 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:25.117690 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.117271 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:25.117690 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.117271 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:25.120926 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.120896 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 19:07:25.121216 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.121195 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 19:07:25.121279 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.121260 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlzv\"" Sep 17 19:07:25.121363 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.121332 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 19:07:25.122730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.121547 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 19:07:25.122730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.122392 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2b6xk\"" Sep 17 19:07:25.408760 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.408672 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76rz2" event={"ID":"c7ce6f2e-667e-48c4-be32-514b826ecd1a","Type":"ContainerStarted","Data":"5c323f0f04c984d581d3e3e028938c92656e3ed1a369189ffd0a08955b5796cf"} Sep 17 19:07:25.410976 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.410871 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwldz" event={"ID":"b338c7d1-81e0-4c88-8611-e776bbe40fb6","Type":"ContainerStarted","Data":"6cbf6eebb4d11abd827181f651f699f2670aed6653789a27febf9ea8accbeaa2"} Sep 17 19:07:25.413722 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.413695 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h5w6" event={"ID":"601abfe7-c77a-4d28-8447-907985bb4cc6","Type":"ContainerStarted","Data":"06ec5f15e052884bc5d9fbd143c26c7efb3565a61016bc18faf04aaedd57fb91"} Sep 17 19:07:25.413851 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:25.413754 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h5w6" event={"ID":"601abfe7-c77a-4d28-8447-907985bb4cc6","Type":"ContainerStarted","Data":"a95829f7fcff8255f5e444ea938dbcfc63a9da3a1b88d28e29a5492f4a49e515"} Sep 17 19:07:26.419684 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:26.419642 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h5w6" event={"ID":"601abfe7-c77a-4d28-8447-907985bb4cc6","Type":"ContainerStarted","Data":"a637f106a54a5f203ed991a458eeac7b1958ab1a53963618b9ae14c57e78e3df"} Sep 17 19:07:26.464839 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:26.464800 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:26.543963 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:26.543876 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:26.778678 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:26.778635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:26.868717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:26.868682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:28.427482 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.427445 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-76rz2" event={"ID":"c7ce6f2e-667e-48c4-be32-514b826ecd1a","Type":"ContainerStarted","Data":"31dd8de9c56ec851b8db6a3623c2241ecb3017a2f0c5da3ba3b4ac8acd75f78a"} Sep 17 19:07:28.429290 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.429265 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwldz" event={"ID":"b338c7d1-81e0-4c88-8611-e776bbe40fb6","Type":"ContainerStarted","Data":"1730f295d01182ac6ae5563cc9d919c04ff56dd5bbf5494fac8ce73d8ecbca53"} Sep 17 19:07:28.429442 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.429309 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xwldz" event={"ID":"b338c7d1-81e0-4c88-8611-e776bbe40fb6","Type":"ContainerStarted","Data":"4efb68235e6492593fd46d4e26477ffc216ca66c09f938f7ce842711fe15ecbe"} Sep 17 19:07:28.429442 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.429362 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:28.431326 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.431303 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5h5w6" event={"ID":"601abfe7-c77a-4d28-8447-907985bb4cc6","Type":"ContainerStarted","Data":"fcc346ca42c54067c47a656d8fa839954e61736d00018de2affb0a05e0523f28"} Sep 17 19:07:28.464706 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.464657 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-76rz2" podStartSLOduration=1.6535623 podStartE2EDuration="4.464640019s" totalImagesPullingTime="2.811077719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:28.464058787 +0000 UTC m=+57.524910415" watchObservedRunningTime="2026-09-17 19:07:28.464640019 +0000 UTC m=+57.525491646" Sep 17 19:07:28.483703 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.483639 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5h5w6" podStartSLOduration=1.79920189 podStartE2EDuration="4.483617054s" totalImagesPullingTime="2.684415164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:07:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:28.482696364 +0000 UTC m=+57.543547991" watchObservedRunningTime="2026-09-17 19:07:28.483617054 +0000 UTC m=+57.544468683" Sep 17 19:07:28.511036 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:28.510969 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xwldz" podStartSLOduration=1.6753383 podStartE2EDuration="4.510946179s" totalImagesPullingTime="2.835607879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:28.508693495 +0000 UTC m=+57.569545119" watchObservedRunningTime="2026-09-17 19:07:28.510946179 +0000 UTC m=+57.571797808" Sep 17 19:07:29.780708 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.780672 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:29.844546 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.844514 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt"] Sep 17 19:07:29.866615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.866563 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:29.876750 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.876721 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt"] Sep 17 19:07:29.876844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.876829 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:29.879712 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.879685 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-psbn7\"" Sep 17 19:07:29.879858 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.879756 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 19:07:29.879858 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.879832 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 19:07:29.879858 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.879851 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 19:07:29.880792 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.880776 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 19:07:29.880869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:29.880840 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 19:07:30.007726 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.007691 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.007900 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.007742 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.007900 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.007764 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89afa468-f592-4cd0-914e-3d8e649fe132-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.007900 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.007854 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4c9\" (UniqueName: \"kubernetes.io/projected/89afa468-f592-4cd0-914e-3d8e649fe132-kube-api-access-8g4c9\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.055654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.055543 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:30.108846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.108810 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.109032 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.108857 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.109032 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.108888 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89afa468-f592-4cd0-914e-3d8e649fe132-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.109032 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.108928 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4c9\" (UniqueName: \"kubernetes.io/projected/89afa468-f592-4cd0-914e-3d8e649fe132-kube-api-access-8g4c9\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.109730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.109696 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89afa468-f592-4cd0-914e-3d8e649fe132-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.112116 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.112093 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.112214 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.112193 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89afa468-f592-4cd0-914e-3d8e649fe132-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.118302 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.118276 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4c9\" (UniqueName: \"kubernetes.io/projected/89afa468-f592-4cd0-914e-3d8e649fe132-kube-api-access-8g4c9\") pod \"prometheus-operator-7bd5d56d6-4s6mt\" (UID: \"89afa468-f592-4cd0-914e-3d8e649fe132\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.185687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.185649 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" Sep 17 19:07:30.483738 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:30.483707 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt"] Sep 17 19:07:30.486770 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:30.486747 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89afa468_f592_4cd0_914e_3d8e649fe132.slice/crio-6d6be96c0a35e335265d42a2ecf5ffe8c6ab69ccedb7ac7452e3e9cf147bc20a WatchSource:0}: Error finding container 6d6be96c0a35e335265d42a2ecf5ffe8c6ab69ccedb7ac7452e3e9cf147bc20a: Status 404 returned error can't find the container with id 6d6be96c0a35e335265d42a2ecf5ffe8c6ab69ccedb7ac7452e3e9cf147bc20a Sep 17 19:07:31.235687 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.235651 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-cf87n"] Sep 17 19:07:31.237856 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.237833 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:31.240711 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.240689 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n25ll\"" Sep 17 19:07:31.241101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.241078 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 19:07:31.241203 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.241158 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 19:07:31.243327 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.243293 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.254144 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.254119 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-cf87n"] Sep 17 19:07:31.317166 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.317107 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.381190 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.381150 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.416453 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.416394 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qtz9\" (UniqueName: \"kubernetes.io/projected/84af57d9-8d9a-4776-abaa-138e227b5f75-kube-api-access-4qtz9\") pod \"downloads-6594f4c75-cf87n\" (UID: \"84af57d9-8d9a-4776-abaa-138e227b5f75\") " pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:31.445948 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.445905 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" event={"ID":"89afa468-f592-4cd0-914e-3d8e649fe132","Type":"ContainerStarted","Data":"6d6be96c0a35e335265d42a2ecf5ffe8c6ab69ccedb7ac7452e3e9cf147bc20a"} Sep 17 19:07:31.517367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.517264 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qtz9\" (UniqueName: \"kubernetes.io/projected/84af57d9-8d9a-4776-abaa-138e227b5f75-kube-api-access-4qtz9\") pod \"downloads-6594f4c75-cf87n\" (UID: \"84af57d9-8d9a-4776-abaa-138e227b5f75\") " pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:31.526201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.526170 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qtz9\" (UniqueName: \"kubernetes.io/projected/84af57d9-8d9a-4776-abaa-138e227b5f75-kube-api-access-4qtz9\") pod \"downloads-6594f4c75-cf87n\" (UID: \"84af57d9-8d9a-4776-abaa-138e227b5f75\") " pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:31.535519 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.535484 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.548800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.548763 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:31.699426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.699397 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.799800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.799704 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:31.850331 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.850291 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-cf87n"] Sep 17 19:07:31.855698 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:31.855651 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84af57d9_8d9a_4776_abaa_138e227b5f75.slice/crio-8f0ce7270fd4b0e2e3c52072c3abcd3d12e7c873ba0eadbd72f1ed8049f562a0 WatchSource:0}: Error finding container 8f0ce7270fd4b0e2e3c52072c3abcd3d12e7c873ba0eadbd72f1ed8049f562a0: Status 404 returned error can't find the container with id 8f0ce7270fd4b0e2e3c52072c3abcd3d12e7c873ba0eadbd72f1ed8049f562a0 Sep 17 19:07:31.925412 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:31.925376 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:32.101483 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.101395 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:32.178779 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.178740 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:32.351911 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.351836 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgsp4" Sep 17 19:07:32.451347 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.451307 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" event={"ID":"89afa468-f592-4cd0-914e-3d8e649fe132","Type":"ContainerStarted","Data":"b0830ab895489f422920e07106d5199681289c8161139ee617cb18a708fb33d5"} Sep 17 19:07:32.451547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.451394 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" event={"ID":"89afa468-f592-4cd0-914e-3d8e649fe132","Type":"ContainerStarted","Data":"bc4a4d1556dcb8127d6bbf3378de84bec5b69f50e87659b67e5268fbde134015"} Sep 17 19:07:32.452648 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.452626 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-cf87n" event={"ID":"84af57d9-8d9a-4776-abaa-138e227b5f75","Type":"ContainerStarted","Data":"8f0ce7270fd4b0e2e3c52072c3abcd3d12e7c873ba0eadbd72f1ed8049f562a0"} Sep 17 19:07:32.469939 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.469886 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4s6mt" podStartSLOduration=2.346904432 podStartE2EDuration="3.469869124s" totalImagesPullingTime="1.122964692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:32.469034018 +0000 UTC m=+61.529885647" watchObservedRunningTime="2026-09-17 19:07:32.469869124 +0000 UTC m=+61.530720752" Sep 17 19:07:32.516866 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.516832 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:32.581851 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.581816 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:32.922996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:32.922896 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:33.365203 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:33.365162 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:33.457874 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:33.457840 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:33.748644 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:33.748603 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.091163 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.091073 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.312766 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.312723 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.441579 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.441494 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.505223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.505188 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn"] Sep 17 19:07:34.508255 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.508232 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.510936 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.510901 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 19:07:34.511080 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.511059 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 19:07:34.512050 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.512031 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ndsrk\"" Sep 17 19:07:34.535045 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.535010 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn"] Sep 17 19:07:34.556673 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.556623 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.560612 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.560587 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4fwr"] Sep 17 19:07:34.562926 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.562898 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.566366 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.566335 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 19:07:34.566909 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.566701 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wssgm\"" Sep 17 19:07:34.566909 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.566731 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 19:07:34.566909 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.566850 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 19:07:34.642840 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.642803 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb20a04-e566-4472-a047-a5db0788e2be-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.643027 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.642894 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.643027 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.642928 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87jkb\" (UniqueName: \"kubernetes.io/projected/4cb20a04-e566-4472-a047-a5db0788e2be-kube-api-access-87jkb\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.643027 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.642986 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.727458 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.727417 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.743561 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743530 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-tls\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743726 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743577 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.743726 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743606 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743726 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743659 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87jkb\" (UniqueName: \"kubernetes.io/projected/4cb20a04-e566-4472-a047-a5db0788e2be-kube-api-access-87jkb\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.743726 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743702 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-metrics-client-ca\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743762 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-wtmp\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743806 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-textfile\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743833 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-sys\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.743887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743866 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb20a04-e566-4472-a047-a5db0788e2be-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.744074 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.743950 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whk6x\" (UniqueName: \"kubernetes.io/projected/69af9d96-75ec-46d8-8e03-3cb7060068a2-kube-api-access-whk6x\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.744074 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.744018 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-root\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.744177 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.744074 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.744177 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.744145 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.744621 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.744590 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cb20a04-e566-4472-a047-a5db0788e2be-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.746616 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.746565 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.746616 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.746569 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cb20a04-e566-4472-a047-a5db0788e2be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.759069 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.759042 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87jkb\" (UniqueName: \"kubernetes.io/projected/4cb20a04-e566-4472-a047-a5db0788e2be-kube-api-access-87jkb\") pod \"openshift-state-metrics-86c5bc79d6-9scjn\" (UID: \"4cb20a04-e566-4472-a047-a5db0788e2be\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.818598 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.818561 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" Sep 17 19:07:34.824208 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.824178 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:34.845170 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845135 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-metrics-client-ca\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845170 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845179 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-wtmp\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845202 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-textfile\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845217 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-sys\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845271 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whk6x\" (UniqueName: \"kubernetes.io/projected/69af9d96-75ec-46d8-8e03-3cb7060068a2-kube-api-access-whk6x\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845309 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-root\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845385 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845407 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-sys\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.845470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845490 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-wtmp\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.846168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845558 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69af9d96-75ec-46d8-8e03-3cb7060068a2-root\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.846168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845681 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-textfile\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.846168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845416 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-tls\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.846168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845758 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.846168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.845855 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-metrics-client-ca\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.847069 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.846186 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.848294 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.848272 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-tls\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.848592 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.848577 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69af9d96-75ec-46d8-8e03-3cb7060068a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.857015 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.856984 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whk6x\" (UniqueName: \"kubernetes.io/projected/69af9d96-75ec-46d8-8e03-3cb7060068a2-kube-api-access-whk6x\") pod \"node-exporter-s4fwr\" (UID: \"69af9d96-75ec-46d8-8e03-3cb7060068a2\") " pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.874122 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.874064 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4fwr" Sep 17 19:07:34.886080 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:34.886015 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69af9d96_75ec_46d8_8e03_3cb7060068a2.slice/crio-9c5cdef4d4cd838080d2bdd511f332c383774fc18510bb6484d508cb1326e3e4 WatchSource:0}: Error finding container 9c5cdef4d4cd838080d2bdd511f332c383774fc18510bb6484d508cb1326e3e4: Status 404 returned error can't find the container with id 9c5cdef4d4cd838080d2bdd511f332c383774fc18510bb6484d508cb1326e3e4 Sep 17 19:07:34.923959 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:34.923920 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:35.100459 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.100367 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:35.103940 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.103819 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn"] Sep 17 19:07:35.106608 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:35.106578 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb20a04_e566_4472_a047_a5db0788e2be.slice/crio-df4f21c79629474b675a147a3af48afe64ae88e74cc696e1fab30d9854c9bd09 WatchSource:0}: Error finding container df4f21c79629474b675a147a3af48afe64ae88e74cc696e1fab30d9854c9bd09: Status 404 returned error can't find the container with id df4f21c79629474b675a147a3af48afe64ae88e74cc696e1fab30d9854c9bd09 Sep 17 19:07:35.324990 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.324950 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:35.444123 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.443997 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:35.471756 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.471709 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" event={"ID":"4cb20a04-e566-4472-a047-a5db0788e2be","Type":"ContainerStarted","Data":"b0e5811cc38ea0c9e6a4ecf2bb394782962b27be050e202f6e4687fc9d719942"} Sep 17 19:07:35.471944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.471824 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" event={"ID":"4cb20a04-e566-4472-a047-a5db0788e2be","Type":"ContainerStarted","Data":"7737d0e995d86d64273d054579c34f938d3b95b49389f35f7be0de5fb002f5f7"} Sep 17 19:07:35.471944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.471856 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" event={"ID":"4cb20a04-e566-4472-a047-a5db0788e2be","Type":"ContainerStarted","Data":"df4f21c79629474b675a147a3af48afe64ae88e74cc696e1fab30d9854c9bd09"} Sep 17 19:07:35.475123 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.475087 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fwr" event={"ID":"69af9d96-75ec-46d8-8e03-3cb7060068a2","Type":"ContainerStarted","Data":"9c5cdef4d4cd838080d2bdd511f332c383774fc18510bb6484d508cb1326e3e4"} Sep 17 19:07:35.731422 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:35.731377 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.307326 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.307286 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.418227 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.418186 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.485088 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.485047 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" event={"ID":"4cb20a04-e566-4472-a047-a5db0788e2be","Type":"ContainerStarted","Data":"ff277ef10cf5c36714f051625ce9a9b951d1ec945d1f5d97b15c62a791705726"} Sep 17 19:07:37.487185 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.487154 2588 generic.go:356] "Generic (PLEG): container finished" podID="69af9d96-75ec-46d8-8e03-3cb7060068a2" containerID="388932bba6c557ff3fc9565bceab723d354fa7d32c0ab429a4d7b9cee042991d" exitCode=0 Sep 17 19:07:37.487314 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.487246 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fwr" event={"ID":"69af9d96-75ec-46d8-8e03-3cb7060068a2","Type":"ContainerDied","Data":"388932bba6c557ff3fc9565bceab723d354fa7d32c0ab429a4d7b9cee042991d"} Sep 17 19:07:37.503995 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.503932 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9scjn" podStartSLOduration=2.062738087 podStartE2EDuration="3.503911403s" totalImagesPullingTime="1.441173316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:37.502720473 +0000 UTC m=+66.563572102" watchObservedRunningTime="2026-09-17 19:07:37.503911403 +0000 UTC m=+66.564763033" Sep 17 19:07:37.510313 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.510276 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.608613 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.608579 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.772088 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.772048 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:37.772276 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.772101 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:37.774782 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.774753 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 19:07:37.775054 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.775036 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 19:07:37.786018 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.785984 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aae7adca-d307-4fd3-9a3c-8fa1bfe1951c-original-pull-secret\") pod \"global-pull-secret-syncer-fdzrj\" (UID: \"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c\") " pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:37.786018 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.785999 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4a2299a-b3d7-43bc-a83d-e63be8e7584f-metrics-certs\") pod \"network-metrics-daemon-82nmg\" (UID: \"e4a2299a-b3d7-43bc-a83d-e63be8e7584f\") " pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:37.839206 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.839104 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:37.872789 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.872761 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:37.875329 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.875303 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 19:07:37.885963 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.885925 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 19:07:37.897106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.897076 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkf8\" (UniqueName: \"kubernetes.io/projected/4b51ccdf-4892-4ca4-8339-cf93ba802a78-kube-api-access-dwkf8\") pod \"network-check-target-kftjw\" (UID: \"4b51ccdf-4892-4ca4-8339-cf93ba802a78\") " pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:37.941397 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:37.941343 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:38.032968 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.032937 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jlzv\"" Sep 17 19:07:38.040187 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.040148 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82nmg" Sep 17 19:07:38.040187 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.040166 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdzrj" Sep 17 19:07:38.040427 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.040386 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2b6xk\"" Sep 17 19:07:38.046450 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.046423 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:38.335587 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.335552 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdzrj"] Sep 17 19:07:38.336643 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.336622 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82nmg"] Sep 17 19:07:38.339513 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:38.339474 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a2299a_b3d7_43bc_a83d_e63be8e7584f.slice/crio-0e433199ec622cb81bc57f09fdfc88fd9083f54986360a9a0107cd541e184495 WatchSource:0}: Error finding container 0e433199ec622cb81bc57f09fdfc88fd9083f54986360a9a0107cd541e184495: Status 404 returned error can't find the container with id 0e433199ec622cb81bc57f09fdfc88fd9083f54986360a9a0107cd541e184495 Sep 17 19:07:38.341063 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:38.340966 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae7adca_d307_4fd3_9a3c_8fa1bfe1951c.slice/crio-bf786c3d6da9020f1a3b57315756cb22b967dccce72b92c022e3700acb5d2dc1 WatchSource:0}: Error finding container bf786c3d6da9020f1a3b57315756cb22b967dccce72b92c022e3700acb5d2dc1: Status 404 returned error can't find the container with id bf786c3d6da9020f1a3b57315756cb22b967dccce72b92c022e3700acb5d2dc1 Sep 17 19:07:38.351064 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.350994 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kftjw"] Sep 17 19:07:38.355893 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:38.355865 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b51ccdf_4892_4ca4_8339_cf93ba802a78.slice/crio-cf0b32fc6ab0ebd3b51799e4b72b654a90e727ff8077776aed8c8bb9ca14cfbf WatchSource:0}: Error finding container cf0b32fc6ab0ebd3b51799e4b72b654a90e727ff8077776aed8c8bb9ca14cfbf: Status 404 returned error can't find the container with id cf0b32fc6ab0ebd3b51799e4b72b654a90e727ff8077776aed8c8bb9ca14cfbf Sep 17 19:07:38.437644 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.437616 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xwldz" Sep 17 19:07:38.493882 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.493842 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82nmg" event={"ID":"e4a2299a-b3d7-43bc-a83d-e63be8e7584f","Type":"ContainerStarted","Data":"0e433199ec622cb81bc57f09fdfc88fd9083f54986360a9a0107cd541e184495"} Sep 17 19:07:38.496514 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.496479 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fwr" event={"ID":"69af9d96-75ec-46d8-8e03-3cb7060068a2","Type":"ContainerStarted","Data":"6e727329d1cbbd24880eb86b3c585cdb024307411ffb1e62f21d2ce820673d04"} Sep 17 19:07:38.496660 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.496543 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4fwr" event={"ID":"69af9d96-75ec-46d8-8e03-3cb7060068a2","Type":"ContainerStarted","Data":"4b0665edb2872c13b14191dbbe95f5db32a5379ae116bddd1a0192de307b7957"} Sep 17 19:07:38.497968 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.497939 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kftjw" event={"ID":"4b51ccdf-4892-4ca4-8339-cf93ba802a78","Type":"ContainerStarted","Data":"cf0b32fc6ab0ebd3b51799e4b72b654a90e727ff8077776aed8c8bb9ca14cfbf"} Sep 17 19:07:38.499395 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.499364 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdzrj" event={"ID":"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c","Type":"ContainerStarted","Data":"bf786c3d6da9020f1a3b57315756cb22b967dccce72b92c022e3700acb5d2dc1"} Sep 17 19:07:38.519535 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.519479 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4fwr" podStartSLOduration=2.637153486 podStartE2EDuration="4.519457278s" totalImagesPullingTime="1.793850386s" totalInitContainerRuntime="88.453406ms" isStatefulPod=true podCreationTimestamp="2026-09-17 19:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:38.51805493 +0000 UTC m=+67.578906560" watchObservedRunningTime="2026-09-17 19:07:38.519457278 +0000 UTC m=+67.580308907" Sep 17 19:07:38.881854 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.881816 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75d9b6bddd-kpcmr"] Sep 17 19:07:38.884190 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.884162 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.887109 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.886933 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 19:07:38.887109 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.886968 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-co3nvptqeflem\"" Sep 17 19:07:38.887291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.887180 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 19:07:38.887820 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.887784 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8mht9\"" Sep 17 19:07:38.888138 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.888067 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 19:07:38.888138 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.888109 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 19:07:38.895924 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.895863 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75d9b6bddd-kpcmr"] Sep 17 19:07:38.982705 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.982645 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-tls\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.982985 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-metrics-server-audit-profiles\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.983053 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c576e5c0-de80-490a-80a6-a78b297486a4-audit-log\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.983089 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-client-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.983119 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.983177 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-client-certs\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:38.983298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:38.983206 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fdsp\" (UniqueName: \"kubernetes.io/projected/c576e5c0-de80-490a-80a6-a78b297486a4-kube-api-access-4fdsp\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.002522 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.002481 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.006439 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.006411 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-b9vls"] Sep 17 19:07:39.008773 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.008742 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.011965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.011512 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tmhd7\"" Sep 17 19:07:39.011965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.011742 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 19:07:39.023169 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.021687 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-b9vls"] Sep 17 19:07:39.072719 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.072682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084478 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084551 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-client-certs\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084585 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fdsp\" (UniqueName: \"kubernetes.io/projected/c576e5c0-de80-490a-80a6-a78b297486a4-kube-api-access-4fdsp\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084630 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-tls\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084664 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-metrics-server-audit-profiles\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084710 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c576e5c0-de80-490a-80a6-a78b297486a4-audit-log\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.085201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.084744 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-client-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.086753 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.085385 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.086753 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.086299 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c576e5c0-de80-490a-80a6-a78b297486a4-audit-log\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.086753 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.086408 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c576e5c0-de80-490a-80a6-a78b297486a4-metrics-server-audit-profiles\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.089382 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.089313 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-client-ca-bundle\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.092258 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.092214 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-tls\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.092920 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.092880 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c576e5c0-de80-490a-80a6-a78b297486a4-secret-metrics-server-client-certs\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.094704 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.094668 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fdsp\" (UniqueName: \"kubernetes.io/projected/c576e5c0-de80-490a-80a6-a78b297486a4-kube-api-access-4fdsp\") pod \"metrics-server-75d9b6bddd-kpcmr\" (UID: \"c576e5c0-de80-490a-80a6-a78b297486a4\") " pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.185944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.185858 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxz9w\" (UniqueName: \"kubernetes.io/projected/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-kube-api-access-mxz9w\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.185944 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.185920 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.198127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.198094 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:39.274833 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.274683 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.286531 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.286488 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.286713 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.286590 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxz9w\" (UniqueName: \"kubernetes.io/projected/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-kube-api-access-mxz9w\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.290642 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.290596 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.306953 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.306923 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxz9w\" (UniqueName: \"kubernetes.io/projected/2bc8c473-3e1a-4bff-9902-9fa6eba79a7f-kube-api-access-mxz9w\") pod \"monitoring-plugin-5984459ff8-b9vls\" (UID: \"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.324506 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.324390 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:39.375884 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.375630 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.451761 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.451658 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.565615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.565462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.662528 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.662466 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:39.777601 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.777564 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75d9b6bddd-kpcmr"] Sep 17 19:07:39.779771 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:39.779671 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-b9vls"] Sep 17 19:07:39.783003 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:39.782977 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc576e5c0_de80_490a_80a6_a78b297486a4.slice/crio-b0b18f0fd98048a5e7f7c50d77116732502b94877bcd7b5431aff5d8125d4979 WatchSource:0}: Error finding container b0b18f0fd98048a5e7f7c50d77116732502b94877bcd7b5431aff5d8125d4979: Status 404 returned error can't find the container with id b0b18f0fd98048a5e7f7c50d77116732502b94877bcd7b5431aff5d8125d4979 Sep 17 19:07:39.784992 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:39.784963 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc8c473_3e1a_4bff_9902_9fa6eba79a7f.slice/crio-af46d8f877179a296648067dabcde6cebc65b1ac719f549087e87496dd35ff0e WatchSource:0}: Error finding container af46d8f877179a296648067dabcde6cebc65b1ac719f549087e87496dd35ff0e: Status 404 returned error can't find the container with id af46d8f877179a296648067dabcde6cebc65b1ac719f549087e87496dd35ff0e Sep 17 19:07:40.512248 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.511919 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82nmg" event={"ID":"e4a2299a-b3d7-43bc-a83d-e63be8e7584f","Type":"ContainerStarted","Data":"1c8a4d481c26286f0506fa80f541bcd09f89226d57767e983338ce3354318907"} Sep 17 19:07:40.512248 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.511977 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82nmg" event={"ID":"e4a2299a-b3d7-43bc-a83d-e63be8e7584f","Type":"ContainerStarted","Data":"d5c88dd04c938e240ee4e1f0dfddd7d0bb0573a9e9365c1fc601e168fa490f97"} Sep 17 19:07:40.515757 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.515678 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" event={"ID":"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f","Type":"ContainerStarted","Data":"af46d8f877179a296648067dabcde6cebc65b1ac719f549087e87496dd35ff0e"} Sep 17 19:07:40.519425 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.519397 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" event={"ID":"c576e5c0-de80-490a-80a6-a78b297486a4","Type":"ContainerStarted","Data":"b0b18f0fd98048a5e7f7c50d77116732502b94877bcd7b5431aff5d8125d4979"} Sep 17 19:07:40.541548 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.541249 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82nmg" podStartSLOduration=66.367388438 podStartE2EDuration="1m7.541225426s" totalImagesPullingTime="1.173836988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:40.538605467 +0000 UTC m=+69.599457096" watchObservedRunningTime="2026-09-17 19:07:40.541225426 +0000 UTC m=+69.602077057" Sep 17 19:07:40.883574 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.883486 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:40.966793 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.964902 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:07:40.971385 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.969102 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:40.973526 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.973273 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 19:07:40.979643 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.978942 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 19:07:40.979643 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.979189 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 19:07:40.979643 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.979454 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 19:07:40.983543 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.983498 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.984007 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.984261 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.984465 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.984790 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-61ubfm538mgg6\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.984977 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 19:07:40.985147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.985073 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 19:07:40.987344 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.987114 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 19:07:40.998706 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.998281 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbjnn\"" Sep 17 19:07:40.998706 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.998379 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 19:07:40.998706 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:40.998671 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 19:07:41.002610 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.002582 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 19:07:41.010908 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.010878 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011037 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.010932 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011037 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.010965 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011155 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011062 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011155 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011094 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011155 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011120 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011319 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011208 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011319 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011237 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011319 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011264 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011319 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011292 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011326 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011347 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckng\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011392 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011474 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011524 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011580 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011552 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011584 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011609 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011657 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.011889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.011730 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.084532 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.084370 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:41.113099 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113061 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113264 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113112 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113264 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113153 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113264 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113179 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113264 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113208 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113264 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113235 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113266 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113289 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckng\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113315 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113341 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113398 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113423 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113450 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113474 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113501 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113525 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.113567 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113566 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.114101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113590 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.114101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113625 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.114101 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.113647 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.119375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.115923 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.119375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.116113 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.119375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.116559 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.119375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.118946 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.119375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.119264 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.120637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.119916 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.120637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.120051 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.120637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.120314 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.121375 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.121329 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.123804 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.123751 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.124532 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.124484 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.125413 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.125128 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.125742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.125703 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.126474 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.126430 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.127038 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.126997 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.128075 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.128027 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.128405 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.128384 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.130314 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.130249 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.132678 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.132637 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.133052 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.132980 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckng\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng\") pod \"prometheus-k8s-0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.143187 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.143080 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:07:41.231702 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.231600 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:41.299557 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.299203 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:07:41.319093 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:41.319008 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:44.333166 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:44.333021 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:45.389913 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:45.389848 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:45.489522 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:45.489476 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:47.215224 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:47.215185 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:47.276419 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:47.276381 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:47.625894 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:47.625854 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:47.693329 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:47.693284 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:49.747684 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:49.747587 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:49.848222 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:49.848185 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:49.944524 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:49.944486 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:52.162383 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.162332 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:07:52.166165 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:07:52.166129 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c4349c_3115_4a7a_8b14_078a122d5ee0.slice/crio-f7ac1b8de572963abad6945a06dcb68b754a1f013fa142ba65aad33f1f5dae2e WatchSource:0}: Error finding container f7ac1b8de572963abad6945a06dcb68b754a1f013fa142ba65aad33f1f5dae2e: Status 404 returned error can't find the container with id f7ac1b8de572963abad6945a06dcb68b754a1f013fa142ba65aad33f1f5dae2e Sep 17 19:07:52.574933 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.574541 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-cf87n" event={"ID":"84af57d9-8d9a-4776-abaa-138e227b5f75","Type":"ContainerStarted","Data":"1221f79eecffc9d2deedb14d0cab7ca2649416bf35466c8b7a5a038c117dcb86"} Sep 17 19:07:52.574933 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.574785 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:52.576850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.576812 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdzrj" event={"ID":"aae7adca-d307-4fd3-9a3c-8fa1bfe1951c","Type":"ContainerStarted","Data":"cadac9e44c115eee5303e2aab3130f6bfea0410c8f41d0a80ef752a2b8710ed8"} Sep 17 19:07:52.578658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.578631 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" event={"ID":"2bc8c473-3e1a-4bff-9902-9fa6eba79a7f","Type":"ContainerStarted","Data":"d7b7623f5498906252b394e3f855b3068fe4be7d0038eb726fb81d265f5ed94e"} Sep 17 19:07:52.578806 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.578763 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:52.580586 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.580275 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"f7ac1b8de572963abad6945a06dcb68b754a1f013fa142ba65aad33f1f5dae2e"} Sep 17 19:07:52.582423 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.582346 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kftjw" event={"ID":"4b51ccdf-4892-4ca4-8339-cf93ba802a78","Type":"ContainerStarted","Data":"21add8c457438f337be3f2d664cf066fd506312a12f3a2a04d3169219792572a"} Sep 17 19:07:52.584873 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.584398 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" event={"ID":"c576e5c0-de80-490a-80a6-a78b297486a4","Type":"ContainerStarted","Data":"b45f7630555f0c0f240916a8d5e9e9ac0d293b992f3fbd6efa46af0c6cc80f83"} Sep 17 19:07:52.584980 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.584902 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" Sep 17 19:07:52.585698 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.585678 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-cf87n" Sep 17 19:07:52.604254 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.602830 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-cf87n" podStartSLOduration=1.4357791469999999 podStartE2EDuration="21.602804799s" totalImagesPullingTime="20.167025652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:52.602281631 +0000 UTC m=+81.663133297" watchObservedRunningTime="2026-09-17 19:07:52.602804799 +0000 UTC m=+81.663656634" Sep 17 19:07:52.672796 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.672220 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" podStartSLOduration=2.582340352 podStartE2EDuration="14.672194886s" totalImagesPullingTime="12.089854534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:52.668102009 +0000 UTC m=+81.728953630" watchObservedRunningTime="2026-09-17 19:07:52.672194886 +0000 UTC m=+81.733046535" Sep 17 19:07:52.727456 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.726386 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-b9vls" podStartSLOduration=2.640341851 podStartE2EDuration="14.726344866s" totalImagesPullingTime="12.086003015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:52.700002482 +0000 UTC m=+81.760854111" watchObservedRunningTime="2026-09-17 19:07:52.726344866 +0000 UTC m=+81.787196497" Sep 17 19:07:52.752162 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.752088 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdzrj" podStartSLOduration=66.207537869 podStartE2EDuration="1m19.752048451s" totalImagesPullingTime="13.544510582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:52.727937971 +0000 UTC m=+81.788789603" watchObservedRunningTime="2026-09-17 19:07:52.752048451 +0000 UTC m=+81.812900080" Sep 17 19:07:52.752672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:52.752628 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kftjw" podStartSLOduration=66.23543032 podStartE2EDuration="1m19.752596262s" totalImagesPullingTime="13.517165942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:07:52.749609348 +0000 UTC m=+81.810461001" watchObservedRunningTime="2026-09-17 19:07:52.752596262 +0000 UTC m=+81.813447908" Sep 17 19:07:53.588904 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:53.588863 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:07:54.489197 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:54.489164 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:54.562928 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:54.562883 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:54.596630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:54.596590 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" exitCode=0 Sep 17 19:07:54.597069 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:54.596695 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} Sep 17 19:07:56.781681 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:56.781558 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:56.865267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:56.865119 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:58.539202 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:58.539167 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:58.611621 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:58.611570 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:58.621215 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:58.621174 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} Sep 17 19:07:59.199045 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:59.199000 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:59.199231 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:59.199076 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:07:59.629417 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:59.629342 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} Sep 17 19:07:59.764430 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:59.764347 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:07:59.856339 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:07:59.856301 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:01.642781 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:01.642743 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} Sep 17 19:08:01.643275 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:01.642815 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} Sep 17 19:08:01.643275 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:01.642849 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} Sep 17 19:08:01.643275 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:01.642883 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerStarted","Data":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} Sep 17 19:08:01.679465 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:01.679401 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=13.985794804 podStartE2EDuration="21.67937887s" totalImagesPullingTime="7.673686955s" totalInitContainerRuntime="19.897111ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:07:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:08:01.677248369 +0000 UTC m=+90.738099996" watchObservedRunningTime="2026-09-17 19:08:01.67937887 +0000 UTC m=+90.740230499" Sep 17 19:08:03.831400 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:03.831343 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:03.947962 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:03.947916 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:04.130491 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:04.130408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:06.300199 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:06.300167 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:11.781453 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:11.781409 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:11.882637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:11.882595 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:17.444518 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:17.444461 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:17.503869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:17.503836 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:19.204126 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:19.204097 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:08:19.207845 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:19.207817 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75d9b6bddd-kpcmr" Sep 17 19:08:24.599955 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:24.599925 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kftjw" Sep 17 19:08:41.300242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:41.300202 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:41.350910 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:41.350881 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:41.803558 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:41.803528 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:53.652744 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:53.652711 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:53.984547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:53.984504 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:55.979086 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:55.979052 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:56.080227 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:56.080184 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:08:59.058309 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058272 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058561 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="prometheus" containerID="cri-o://70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" gracePeriod=600 Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058602 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy" containerID="cri-o://7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" gracePeriod=600 Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058638 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="thanos-sidecar" containerID="cri-o://db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" gracePeriod=600 Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058646 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="config-reloader" containerID="cri-o://b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" gracePeriod=600 Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058655 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-web" containerID="cri-o://7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" gracePeriod=600 Sep 17 19:08:59.058857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.058666 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" gracePeriod=600 Sep 17 19:08:59.320152 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.320120 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.348891 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.348856 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.348891 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.348897 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.348918 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.348937 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.348960 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349082 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349131 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349168 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349198 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349234 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349257 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349282 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349287 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349308 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349336 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349394 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.349426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349418 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.350058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349458 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.350058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349499 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.350058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349527 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ckng\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.350058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349558 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca\") pod \"04c4349c-3115-4a7a-8b14-078a122d5ee0\" (UID: \"04c4349c-3115-4a7a-8b14-078a122d5ee0\") " Sep 17 19:08:59.350058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.349781 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.350312 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350145 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.350312 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350208 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.350312 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350255 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.350555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350404 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.351371 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350904 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.351371 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.350932 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:08:59.351371 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.351083 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:08:59.352722 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.352685 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.352841 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.352754 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:08:59.353010 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.352984 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config" (OuterVolumeSpecName: "config") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.353172 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.353147 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.353963 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.353931 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out" (OuterVolumeSpecName: "config-out") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:08:59.354073 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.354046 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.354327 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.354185 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.354427 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.354336 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.355974 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.354511 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.355974 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.354723 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng" (OuterVolumeSpecName: "kube-api-access-4ckng") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "kube-api-access-4ckng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:08:59.356935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.356831 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.371008 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.370954 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config" (OuterVolumeSpecName: "web-config") pod "04c4349c-3115-4a7a-8b14-078a122d5ee0" (UID: "04c4349c-3115-4a7a-8b14-078a122d5ee0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:08:59.450965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450923 2588 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-config-out\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.450965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450956 2588 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-metrics-client-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.450965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450969 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.450965 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450978 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450988 2588 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-web-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.450996 2588 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451004 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ckng\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-kube-api-access-4ckng\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451013 2588 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-configmap-metrics-client-ca\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451023 2588 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04c4349c-3115-4a7a-8b14-078a122d5ee0-tls-assets\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451030 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451038 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451048 2588 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-config\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451063 2588 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-grpc-tls\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451071 2588 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451079 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451088 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451096 2588 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04c4349c-3115-4a7a-8b14-078a122d5ee0-secret-kube-rbac-proxy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451103 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.451310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.451111 2588 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/04c4349c-3115-4a7a-8b14-078a122d5ee0-prometheus-k8s-db\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:08:59.856674 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856635 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" exitCode=0 Sep 17 19:08:59.856674 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856665 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" exitCode=0 Sep 17 19:08:59.856674 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856673 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" exitCode=0 Sep 17 19:08:59.856674 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856678 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" exitCode=0 Sep 17 19:08:59.856674 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856683 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" exitCode=0 Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856688 2588 generic.go:356] "Generic (PLEG): container finished" podID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" exitCode=0 Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856724 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856722 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856795 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856825 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856852 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856871 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856878 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856905 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} Sep 17 19:08:59.856956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.856929 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"04c4349c-3115-4a7a-8b14-078a122d5ee0","Type":"ContainerDied","Data":"f7ac1b8de572963abad6945a06dcb68b754a1f013fa142ba65aad33f1f5dae2e"} Sep 17 19:08:59.864851 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.864818 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.872005 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.871986 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.879192 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.879167 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.881518 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.881489 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:08:59.884850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.884823 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:08:59.887504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.887486 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.894453 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.894434 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.901807 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.901789 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.911469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.911069 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.912023 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.911971 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.912133 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912035 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.912133 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912073 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.912398 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.912381 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.912486 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912402 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.912486 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912416 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.912701 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.912681 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.912757 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912708 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.912757 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912725 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.912996 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.912977 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:08:59.912996 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.912988 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.913130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913007 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.913130 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913020 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.913287 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.913272 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.913337 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913289 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.913337 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913301 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.913337 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913332 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="prometheus" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913365 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="prometheus" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913384 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="config-reloader" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913394 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="config-reloader" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913421 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913429 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913440 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="init-config-reloader" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913449 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="init-config-reloader" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913458 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="thanos-sidecar" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913467 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="thanos-sidecar" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913477 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-web" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913485 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-web" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913495 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-thanos" Sep 17 19:08:59.913517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913505 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-thanos" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.913518 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913538 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913550 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913576 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-thanos" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913589 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="prometheus" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913598 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="thanos-sidecar" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913610 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy-web" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913618 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="config-reloader" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913626 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" containerName="kube-rbac-proxy" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:08:59.913736 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913753 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913764 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913953 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.914119 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.913967 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914173 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914191 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914410 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914423 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914631 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.914830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914643 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.915106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914842 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.915106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.914855 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.915106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915069 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.915106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915080 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.915273 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915257 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.915273 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915272 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.915462 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915447 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.915499 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915462 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.915636 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915622 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.915711 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915636 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.915858 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915833 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.915934 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.915860 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.916124 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916099 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.916192 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916126 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.916410 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916389 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.916410 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916409 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.916631 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916614 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.916682 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916631 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.916867 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916848 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.916867 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.916867 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.917168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917149 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.917168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917166 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.917460 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917422 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.917460 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917460 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.917769 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917745 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.917842 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917771 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.917898 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.917872 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.918261 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918069 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.918261 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918092 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.918682 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918633 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.918733 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918687 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.918943 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918926 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.918994 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.918944 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.919180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919161 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.919180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919180 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.919483 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919456 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.919540 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919486 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.919742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919725 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.919781 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919743 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.919980 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919959 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.920063 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.919980 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.920242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920225 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.920310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920243 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.920448 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920423 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 19:08:59.920448 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920437 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 19:08:59.920448 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920443 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbjnn\"" Sep 17 19:08:59.920626 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920450 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 19:08:59.920626 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920556 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.920626 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920578 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.920751 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920736 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 19:08:59.920882 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920839 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 19:08:59.920967 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920876 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.920967 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920885 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 19:08:59.920967 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.920893 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.921127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921005 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 19:08:59.921127 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921009 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 19:08:59.921221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921181 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.921221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921207 2588 scope.go:117] "RemoveContainer" containerID="706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998" Sep 17 19:08:59.921410 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921387 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 19:08:59.921529 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921468 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998"} err="failed to get container status \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": rpc error: code = NotFound desc = could not find container \"706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998\": container with ID starting with 706e172ca4b3a8b067d6797bbe25619dc12dea267b3c18416393f65dba5ee998 not found: ID does not exist" Sep 17 19:08:59.921529 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921491 2588 scope.go:117] "RemoveContainer" containerID="7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24" Sep 17 19:08:59.921827 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921810 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-61ubfm538mgg6\"" Sep 17 19:08:59.921827 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921817 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24"} err="failed to get container status \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": rpc error: code = NotFound desc = could not find container \"7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24\": container with ID starting with 7918deb08a8e612aca6244b069e11048eb2816791d062867c4ed191ded312e24 not found: ID does not exist" Sep 17 19:08:59.921976 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.921840 2588 scope.go:117] "RemoveContainer" containerID="7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd" Sep 17 19:08:59.922110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922093 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd"} err="failed to get container status \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": rpc error: code = NotFound desc = could not find container \"7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd\": container with ID starting with 7831708590b81fed6be48ec91f4d7ad4eafa0d086e70e36a933095ce3c8501dd not found: ID does not exist" Sep 17 19:08:59.922151 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922111 2588 scope.go:117] "RemoveContainer" containerID="db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922329 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4"} err="failed to get container status \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": rpc error: code = NotFound desc = could not find container \"db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4\": container with ID starting with db60d99d36343ffd0e954e9b3432407a1a141c6cef67611ec776cd5ed873a2f4 not found: ID does not exist" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922367 2588 scope.go:117] "RemoveContainer" containerID="b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922651 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084"} err="failed to get container status \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": rpc error: code = NotFound desc = could not find container \"b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084\": container with ID starting with b44137da19fafe7eb8c804f77721744c28164cb86c4c8f81ddc050e20fcf0084 not found: ID does not exist" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922674 2588 scope.go:117] "RemoveContainer" containerID="70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.922943 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.923026 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 19:08:59.924584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.923933 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 19:08:59.924960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.924593 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860"} err="failed to get container status \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": rpc error: code = NotFound desc = could not find container \"70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860\": container with ID starting with 70f9b6813c426141a153b2a54fb66655dac2b530b4329fb3d422e6fe968e6860 not found: ID does not exist" Sep 17 19:08:59.924960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.924616 2588 scope.go:117] "RemoveContainer" containerID="43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90" Sep 17 19:08:59.924960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.924950 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90"} err="failed to get container status \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": rpc error: code = NotFound desc = could not find container \"43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90\": container with ID starting with 43c36ffa6c25b088bcd3b9d002b3ed51d3bf0ea7a822b0f3184b9385b65cac90 not found: ID does not exist" Sep 17 19:08:59.925964 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.925944 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 19:08:59.928107 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.928086 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 19:08:59.936122 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.936097 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:08:59.954403 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954376 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954411 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954432 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954455 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-web-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954480 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-config-out\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954501 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954522 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954540 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954618 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954648 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954668 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954684 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954721 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954753 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.954785 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954778 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.955040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954801 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqmfq\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-kube-api-access-wqmfq\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.955040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954848 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.955040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954868 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.955040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954882 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:08:59.955040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:08:59.954903 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056140 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-config-out\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056176 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056195 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056309 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056394 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056414 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056431 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.056469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056451 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056482 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056518 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056543 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056570 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqmfq\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-kube-api-access-wqmfq\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056621 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056648 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056674 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056715 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056758 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056768 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056783 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056810 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.056834 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-web-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.057262 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.057341 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.057811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.057790 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.058889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.057938 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.058889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.057996 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.058889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.058343 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.060223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.059658 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.060223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.060176 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.060889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.060856 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-web-config\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061018 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.060992 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061220 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061195 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3878c1d0-5868-46ba-889c-9822278aff15-config-out\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061443 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061459 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061663 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061645 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061724 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061703 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3878c1d0-5868-46ba-889c-9822278aff15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.061977 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.061950 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.062090 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.062075 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3878c1d0-5868-46ba-889c-9822278aff15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.062546 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.062528 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.065905 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.065885 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqmfq\" (UniqueName: \"kubernetes.io/projected/3878c1d0-5868-46ba-889c-9822278aff15-kube-api-access-wqmfq\") pod \"prometheus-k8s-0\" (UID: \"3878c1d0-5868-46ba-889c-9822278aff15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.230370 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.230300 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:00.511459 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.511365 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 19:09:00.515380 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:09:00.515337 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3878c1d0_5868_46ba_889c_9822278aff15.slice/crio-ee3ca83f699fd149337309c3197b37489b7c79aea8e6359ba7755052235cbab9 WatchSource:0}: Error finding container ee3ca83f699fd149337309c3197b37489b7c79aea8e6359ba7755052235cbab9: Status 404 returned error can't find the container with id ee3ca83f699fd149337309c3197b37489b7c79aea8e6359ba7755052235cbab9 Sep 17 19:09:00.863554 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.863465 2588 generic.go:356] "Generic (PLEG): container finished" podID="3878c1d0-5868-46ba-889c-9822278aff15" containerID="854ac065ae41f66f55e369061b9bef934787fec4f456c715ac465fb1719e65e9" exitCode=0 Sep 17 19:09:00.863554 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.863520 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerDied","Data":"854ac065ae41f66f55e369061b9bef934787fec4f456c715ac465fb1719e65e9"} Sep 17 19:09:00.863736 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:00.863570 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"ee3ca83f699fd149337309c3197b37489b7c79aea8e6359ba7755052235cbab9"} Sep 17 19:09:01.123490 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.123454 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04c4349c-3115-4a7a-8b14-078a122d5ee0" path="/var/lib/kubelet/pods/04c4349c-3115-4a7a-8b14-078a122d5ee0/volumes" Sep 17 19:09:01.871052 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871016 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"1e3dd65c2aa9c4b734f86ca43ebe545e4b834b0d76600d6e9cedd4450f8fc3aa"} Sep 17 19:09:01.871256 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871089 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"7793bf5ebacb9d6d83987924695831ba3dd602e55d09f9521fc672c999c9595f"} Sep 17 19:09:01.871256 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871117 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"dc649cc6e02ece659d2b231b3489ac46ca77e3a18b4c3f9a5612be69380213f8"} Sep 17 19:09:01.871256 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871140 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"ecdd5ced8dd4f1c6051ed34719a28b6e82f7f9f6e4a8d97139a921881729f2ab"} Sep 17 19:09:01.871256 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871164 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"4f7db27a7d0d39d542abd37a858d2173b8f4bd24cc51a35c7cb42b44737cda9c"} Sep 17 19:09:01.871256 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.871186 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3878c1d0-5868-46ba-889c-9822278aff15","Type":"ContainerStarted","Data":"780f48817c7bb1d92a385854985b560ecdbe96298a2461f12a193df5cc366afd"} Sep 17 19:09:01.905294 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:01.905238 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.882757091 podStartE2EDuration="2.905219675s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.462584ms" isStatefulPod=false podCreationTimestamp="2026-09-17 19:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:09:01.904268966 +0000 UTC m=+150.965120605" watchObservedRunningTime="2026-09-17 19:09:01.905219675 +0000 UTC m=+150.966071303" Sep 17 19:09:02.110671 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:02.110635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:02.241666 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:02.241635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:05.231022 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:05.230986 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:09:13.210775 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:13.210738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:13.284730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:13.284695 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:30.109539 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:30.109501 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:09:30.223415 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:09:30.223380 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:00.231074 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:00.231034 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:10:00.246993 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:00.246962 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:10:01.100363 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:01.100330 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 19:10:08.989376 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:08.989312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:09.110582 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:09.110550 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:20.961022 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:20.960989 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:21.061092 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:21.061057 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:26.790565 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:26.790524 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:26.889180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:26.889142 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:31.494865 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:31.494831 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:31.595676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:31.595634 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:34.338175 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:34.338142 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:39.379697 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:39.379658 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:42.479883 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:42.479838 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:42.579825 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:42.579791 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:10:42.682791 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:10:42.682761 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:02.671619 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:02.671536 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:02.770220 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:02.770186 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:02.872309 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:02.872265 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:25.213876 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:25.213837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:26.591395 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:26.591364 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.203201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.203164 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.480559 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.480515 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.645507 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.645472 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.746836 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.746740 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.807235 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.807196 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.927895 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.927858 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:31.995558 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:31.995524 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.471987 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.471952 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.592844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.592809 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.686903 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.686866 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.861471 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.861439 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.965017 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.964985 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:11:32.996756 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:32.996724 2588 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 19:11:38.789850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:11:38.789804 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:23.916397 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:23.916286 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:24.017937 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:24.017904 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:35.262228 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:35.262184 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:36.529334 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:36.529297 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:38.882995 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:38.882955 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:38.983751 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:38.983723 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:40.389711 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.389673 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:40.508244 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.508209 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:40.799945 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.799906 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nhcgz"] Sep 17 19:12:40.802058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.802035 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.805025 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.805005 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 19:12:40.805165 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.805043 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9slhn\"" Sep 17 19:12:40.805869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.805853 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 19:12:40.818717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.818677 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nhcgz"] Sep 17 19:12:40.820635 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.820610 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.820743 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.820658 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6f6\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-kube-api-access-4g6f6\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.921146 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.921106 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.921146 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.921154 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6f6\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-kube-api-access-4g6f6\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.943761 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.943728 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:40.944056 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:40.944031 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6f6\" (UniqueName: \"kubernetes.io/projected/3b302d52-2bff-4b97-9a7d-f36edf95f5bc-kube-api-access-4g6f6\") pod \"cert-manager-webhook-6486ffd997-nhcgz\" (UID: \"3b302d52-2bff-4b97-9a7d-f36edf95f5bc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:41.122914 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:41.122789 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:41.394440 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:41.394333 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nhcgz"] Sep 17 19:12:41.398312 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:12:41.398281 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b302d52_2bff_4b97_9a7d_f36edf95f5bc.slice/crio-4dad0c9a4569d961634cf94d92705e43c42328804805f83d4ab0080a1b7a5563 WatchSource:0}: Error finding container 4dad0c9a4569d961634cf94d92705e43c42328804805f83d4ab0080a1b7a5563: Status 404 returned error can't find the container with id 4dad0c9a4569d961634cf94d92705e43c42328804805f83d4ab0080a1b7a5563 Sep 17 19:12:41.400087 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:41.400068 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 19:12:41.639413 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:41.639372 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" event={"ID":"3b302d52-2bff-4b97-9a7d-f36edf95f5bc","Type":"ContainerStarted","Data":"4dad0c9a4569d961634cf94d92705e43c42328804805f83d4ab0080a1b7a5563"} Sep 17 19:12:42.567842 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:42.567781 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:42.973015 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:42.972887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:43.880789 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.880746 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:43.932723 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.932691 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5"] Sep 17 19:12:43.935260 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.935232 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:43.937680 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.937644 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-njhpl\"" Sep 17 19:12:43.946654 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.946624 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5"] Sep 17 19:12:43.954005 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:43.953971 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:44.046107 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.046072 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjzck\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-kube-api-access-gjzck\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.046292 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.046162 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.146742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.146651 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjzck\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-kube-api-access-gjzck\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.146955 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.146918 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.155331 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.155301 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.155516 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.155485 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjzck\" (UniqueName: \"kubernetes.io/projected/40e60c28-13f1-4129-ac19-e74ff9818df8-kube-api-access-gjzck\") pod \"cert-manager-cainjector-559cdd8c87-s5pr5\" (UID: \"40e60c28-13f1-4129-ac19-e74ff9818df8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.247902 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.247862 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" Sep 17 19:12:44.941721 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:44.941648 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5"] Sep 17 19:12:44.944989 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:12:44.944962 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40e60c28_13f1_4129_ac19_e74ff9818df8.slice/crio-d5617a696d4200463083aae14af6436fcb55df699d371107c3c166f3298a752a WatchSource:0}: Error finding container d5617a696d4200463083aae14af6436fcb55df699d371107c3c166f3298a752a: Status 404 returned error can't find the container with id d5617a696d4200463083aae14af6436fcb55df699d371107c3c166f3298a752a Sep 17 19:12:45.419579 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.419538 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:45.535749 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.535710 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:45.633945 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.633906 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:45.658557 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.658532 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" event={"ID":"3b302d52-2bff-4b97-9a7d-f36edf95f5bc","Type":"ContainerStarted","Data":"360caadb6aba0d8616c2faac702329318af24784f3095c68249cffd45b874460"} Sep 17 19:12:45.658708 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.658639 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:45.660212 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.660185 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" event={"ID":"40e60c28-13f1-4129-ac19-e74ff9818df8","Type":"ContainerStarted","Data":"4ed49cacd0160393c641fcbd8b7f4f57fd0840c174fb64fea394d2afcadf5ccd"} Sep 17 19:12:45.660320 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.660220 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" event={"ID":"40e60c28-13f1-4129-ac19-e74ff9818df8","Type":"ContainerStarted","Data":"d5617a696d4200463083aae14af6436fcb55df699d371107c3c166f3298a752a"} Sep 17 19:12:45.676186 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.676094 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" podStartSLOduration=2.357680208 podStartE2EDuration="5.676077591s" totalImagesPullingTime="3.318397383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:12:45.675426236 +0000 UTC m=+374.736277863" watchObservedRunningTime="2026-09-17 19:12:45.676077591 +0000 UTC m=+374.736929219" Sep 17 19:12:45.692892 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:45.692836 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s5pr5" podStartSLOduration=2.692817404 podStartE2EDuration="2.692817404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:12:45.69170871 +0000 UTC m=+374.752560336" watchObservedRunningTime="2026-09-17 19:12:45.692817404 +0000 UTC m=+374.753669033" Sep 17 19:12:48.300982 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:48.300943 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:48.375531 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:48.375497 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:51.167760 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.167702 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:51.667816 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.667781 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nhcgz" Sep 17 19:12:51.669819 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.669793 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2mvhl"] Sep 17 19:12:51.672018 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.671999 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.675845 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.675827 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t2tnw\"" Sep 17 19:12:51.686223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.686198 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2mvhl"] Sep 17 19:12:51.706293 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.706245 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sbf8\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-kube-api-access-4sbf8\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.706469 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.706416 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.808045 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.808008 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.808194 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.808065 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sbf8\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-kube-api-access-4sbf8\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.818199 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.818161 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.819198 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.819178 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sbf8\" (UniqueName: \"kubernetes.io/projected/b0017a9c-bce5-421d-9b56-b641376cdbb0-kube-api-access-4sbf8\") pod \"cert-manager-55b4d954d5-2mvhl\" (UID: \"b0017a9c-bce5-421d-9b56-b641376cdbb0\") " pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:51.981057 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:51.981024 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2mvhl" Sep 17 19:12:52.250160 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:52.250083 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2mvhl"] Sep 17 19:12:52.255129 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:12:52.255100 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0017a9c_bce5_421d_9b56_b641376cdbb0.slice/crio-b9330b0cd050e927de0a64b19958b97556c39a9bb906077d3b9a54597be67bd6 WatchSource:0}: Error finding container b9330b0cd050e927de0a64b19958b97556c39a9bb906077d3b9a54597be67bd6: Status 404 returned error can't find the container with id b9330b0cd050e927de0a64b19958b97556c39a9bb906077d3b9a54597be67bd6 Sep 17 19:12:52.687767 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:52.687676 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2mvhl" event={"ID":"b0017a9c-bce5-421d-9b56-b641376cdbb0","Type":"ContainerStarted","Data":"942a82940b84b24e907e840ed5a6fa03ccd4a1ed0f75b7317b1f68100326e3eb"} Sep 17 19:12:52.687767 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:52.687721 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2mvhl" event={"ID":"b0017a9c-bce5-421d-9b56-b641376cdbb0","Type":"ContainerStarted","Data":"b9330b0cd050e927de0a64b19958b97556c39a9bb906077d3b9a54597be67bd6"} Sep 17 19:12:52.704151 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:52.704106 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2mvhl" podStartSLOduration=1.704086714 podStartE2EDuration="1.704086714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:12:52.703646041 +0000 UTC m=+381.764497669" watchObservedRunningTime="2026-09-17 19:12:52.704086714 +0000 UTC m=+381.764938338" Sep 17 19:12:54.893628 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:54.893592 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:54.994585 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:54.994550 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:59.080279 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:59.080234 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:59.272110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:59.272083 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:12:59.375242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:12:59.375146 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:03.830986 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:03.830943 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:08.557306 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:08.557276 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:08.651952 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:08.651916 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:09.568989 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:09.568951 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:10.737826 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:10.737790 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:10.814720 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:10.814655 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:13.395237 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:13.395202 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:13.495030 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:13.494959 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:17.477885 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.477850 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb"] Sep 17 19:13:17.480442 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.480418 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.485813 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.485784 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-29d5k\"" Sep 17 19:13:17.485956 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.485901 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 19:13:17.486745 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.486718 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 19:13:17.487738 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.487721 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 19:13:17.511045 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.511005 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb"] Sep 17 19:13:17.563825 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.563790 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:17.617880 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.617835 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618003 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.617889 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618003 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.617905 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618003 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.617980 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618141 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.618016 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618141 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.618040 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618240 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.618131 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618240 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.618178 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.618415 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.618241 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qfl\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-kube-api-access-55qfl\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.640137 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.640090 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:17.719287 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719245 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719298 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719330 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719502 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719392 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719504 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719555 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qfl\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-kube-api-access-55qfl\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719602 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719641 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719873 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719684 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.719873 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.719849 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-certs\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.720099 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.720074 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-workload-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.720196 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.720094 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-data\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.720196 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.720145 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-credential-socket\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.720267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.720201 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.721877 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.721858 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-envoy\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.722171 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.722149 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.728010 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.727933 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-istio-token\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.728129 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.728069 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qfl\" (UniqueName: \"kubernetes.io/projected/b3bd6da9-f6b3-44eb-90a3-42e42196e0c2-kube-api-access-55qfl\") pod \"openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb\" (UID: \"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:17.791505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:17.791465 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:18.066737 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:18.066658 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb"] Sep 17 19:13:18.069889 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:13:18.069858 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bd6da9_f6b3_44eb_90a3_42e42196e0c2.slice/crio-ebdb99b1b5820d3662e01a0a2e0adc690f87d96f70039e4411cd97fc306c81fb WatchSource:0}: Error finding container ebdb99b1b5820d3662e01a0a2e0adc690f87d96f70039e4411cd97fc306c81fb: Status 404 returned error can't find the container with id ebdb99b1b5820d3662e01a0a2e0adc690f87d96f70039e4411cd97fc306c81fb Sep 17 19:13:18.785457 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:18.785423 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" event={"ID":"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2","Type":"ContainerStarted","Data":"ebdb99b1b5820d3662e01a0a2e0adc690f87d96f70039e4411cd97fc306c81fb"} Sep 17 19:13:20.347408 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:20.347221 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:20.974239 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:20.974199 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:13:20.974389 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:20.974286 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:13:20.974389 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:20.974330 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:13:21.800171 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:21.800139 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" event={"ID":"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2","Type":"ContainerStarted","Data":"d60caf71b40e9ff275c5d7d5c0dc01f6a139533e9c45300d3b90547dd5e5a10c"} Sep 17 19:13:21.820406 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:21.820338 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podStartSLOduration=1.9183270220000002 podStartE2EDuration="4.820319189s" totalImagesPullingTime="2.901992167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:21.819455088 +0000 UTC m=+410.880306722" watchObservedRunningTime="2026-09-17 19:13:21.820319189 +0000 UTC m=+410.881170817" Sep 17 19:13:22.792063 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:22.792025 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:22.796887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:22.796860 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:22.804346 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:22.804318 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:22.805261 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:22.805246 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:13:23.030991 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:23.030959 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:23.132712 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:23.132620 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:26.283912 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.283868 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:26.628192 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.628090 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:26.686066 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.686032 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh"] Sep 17 19:13:26.688288 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.688268 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.691079 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.691052 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 19:13:26.691079 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.691076 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 19:13:26.692336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.692314 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 19:13:26.692463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.692346 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 19:13:26.692463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.692346 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9qxtz\"" Sep 17 19:13:26.692463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.692347 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 19:13:26.701616 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.701587 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh"] Sep 17 19:13:26.722091 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.722045 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:26.803441 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.803395 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-manager-config\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.803617 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.803532 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.803617 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.803562 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-metrics-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.803617 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.803588 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9l5l\" (UniqueName: \"kubernetes.io/projected/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-kube-api-access-p9l5l\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.904443 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.904328 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.904443 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.904393 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-metrics-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.904443 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.904426 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9l5l\" (UniqueName: \"kubernetes.io/projected/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-kube-api-access-p9l5l\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.904673 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.904455 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-manager-config\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.905201 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.905178 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-manager-config\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.906935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.906910 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-metrics-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.906935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.906931 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-cert\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.922435 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.922407 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9l5l\" (UniqueName: \"kubernetes.io/projected/6621082d-6d99-4d6b-91fe-cf26fd3adf2a-kube-api-access-p9l5l\") pod \"lws-controller-manager-56c5b7c858-52zwh\" (UID: \"6621082d-6d99-4d6b-91fe-cf26fd3adf2a\") " pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:26.998245 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:26.998204 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:27.272527 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:27.272496 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh"] Sep 17 19:13:27.275407 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:13:27.275376 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6621082d_6d99_4d6b_91fe_cf26fd3adf2a.slice/crio-51003490454f2e1c6932cf7be76ed1650a54f65f6ac7fcb8473c1fa5381bd022 WatchSource:0}: Error finding container 51003490454f2e1c6932cf7be76ed1650a54f65f6ac7fcb8473c1fa5381bd022: Status 404 returned error can't find the container with id 51003490454f2e1c6932cf7be76ed1650a54f65f6ac7fcb8473c1fa5381bd022 Sep 17 19:13:27.823650 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:27.823618 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" event={"ID":"6621082d-6d99-4d6b-91fe-cf26fd3adf2a","Type":"ContainerStarted","Data":"51003490454f2e1c6932cf7be76ed1650a54f65f6ac7fcb8473c1fa5381bd022"} Sep 17 19:13:29.834070 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:29.834036 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" event={"ID":"6621082d-6d99-4d6b-91fe-cf26fd3adf2a","Type":"ContainerStarted","Data":"70df1945ff87f761bec15d2c73cfe7efd372835fe45ddfc1ea134c36925a712a"} Sep 17 19:13:29.834470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:29.834183 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:29.852006 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:29.851954 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" podStartSLOduration=1.392761882 podStartE2EDuration="3.851938828s" totalImagesPullingTime="2.459176946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:29.851224893 +0000 UTC m=+418.912076522" watchObservedRunningTime="2026-09-17 19:13:29.851938828 +0000 UTC m=+418.912790456" Sep 17 19:13:35.749398 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:35.749343 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:38.119102 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:38.119060 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:38.515803 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:38.515755 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:38.750303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:38.750270 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:38.856110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:38.856025 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:38.964139 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:38.964105 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:40.840770 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:40.840743 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56c5b7c858-52zwh" Sep 17 19:13:41.392475 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:41.392435 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:42.159240 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:42.159207 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:42.504244 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:42.504205 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:42.628037 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:42.628002 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:44.344857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.344778 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:44.474310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.474272 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:44.707639 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.707560 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-nhvsq"] Sep 17 19:13:44.710714 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.710697 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:44.713805 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.713779 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ckcxk\"" Sep 17 19:13:44.714013 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.713998 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 19:13:44.714621 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.714606 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 19:13:44.729500 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.729471 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-nhvsq"] Sep 17 19:13:44.750441 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.750406 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsmr\" (UniqueName: \"kubernetes.io/projected/e3405338-a760-4ce0-abe5-5e18f75c3950-kube-api-access-znsmr\") pod \"authorino-operator-6fc8f864f4-nhvsq\" (UID: \"e3405338-a760-4ce0-abe5-5e18f75c3950\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:44.851551 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.851511 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znsmr\" (UniqueName: \"kubernetes.io/projected/e3405338-a760-4ce0-abe5-5e18f75c3950-kube-api-access-znsmr\") pod \"authorino-operator-6fc8f864f4-nhvsq\" (UID: \"e3405338-a760-4ce0-abe5-5e18f75c3950\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:44.875577 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:44.875537 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsmr\" (UniqueName: \"kubernetes.io/projected/e3405338-a760-4ce0-abe5-5e18f75c3950-kube-api-access-znsmr\") pod \"authorino-operator-6fc8f864f4-nhvsq\" (UID: \"e3405338-a760-4ce0-abe5-5e18f75c3950\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:45.021292 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:45.021248 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:45.140553 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:45.140515 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:45.340588 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:45.340558 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-nhvsq"] Sep 17 19:13:45.342799 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:13:45.342752 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3405338_a760_4ce0_abe5_5e18f75c3950.slice/crio-eaf96a30afe11f7631591a0acd65d0fe53a5873b262cc27be3f770ead13da6ed WatchSource:0}: Error finding container eaf96a30afe11f7631591a0acd65d0fe53a5873b262cc27be3f770ead13da6ed: Status 404 returned error can't find the container with id eaf96a30afe11f7631591a0acd65d0fe53a5873b262cc27be3f770ead13da6ed Sep 17 19:13:45.538406 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:45.538363 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:45.900584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:45.900539 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" event={"ID":"e3405338-a760-4ce0-abe5-5e18f75c3950","Type":"ContainerStarted","Data":"eaf96a30afe11f7631591a0acd65d0fe53a5873b262cc27be3f770ead13da6ed"} Sep 17 19:13:47.459498 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:47.459467 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:47.910477 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:47.910442 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" event={"ID":"e3405338-a760-4ce0-abe5-5e18f75c3950","Type":"ContainerStarted","Data":"88c18c7612ee3506aa3142c489dc0761518f440f5a1183405aedf3ae8f27dac9"} Sep 17 19:13:47.910658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:47.910562 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:13:47.932186 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:47.932129 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" podStartSLOduration=1.504609493 podStartE2EDuration="3.932112461s" totalImagesPullingTime="2.427502968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:47.930278669 +0000 UTC m=+436.991130301" watchObservedRunningTime="2026-09-17 19:13:47.932112461 +0000 UTC m=+436.992964091" Sep 17 19:13:48.115864 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:48.115779 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:48.216576 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:48.216540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:48.596202 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:48.596160 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:48.691412 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:48.691347 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.004413 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.004380 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.100810 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.100773 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.320755 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.320682 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.417963 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.417932 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.537892 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.537862 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:52.636556 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:52.636456 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:13:58.916852 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:13:58.916820 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-nhvsq" Sep 17 19:14:00.520292 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:00.520248 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:00.625816 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:00.625764 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:02.977642 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:02.977607 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:03.078709 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:03.078677 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:07.309937 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:07.309896 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:07.427915 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:07.427875 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:11.177583 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:11.177545 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:11.274876 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:11.274836 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:11.373277 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:11.373236 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:12.325330 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:12.325294 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:12.399614 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:12.399574 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:21.545622 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:21.545583 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:21.643277 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:21.643244 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:23.963503 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:23.963466 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:24.060595 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:24.060558 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:30.433369 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:30.433311 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:30.543135 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:30.543095 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:30.614412 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:30.614339 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:31.265282 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.265242 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:31.275393 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.275339 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:31.276085 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.276058 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:31.276194 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.276159 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:31.278475 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.278454 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t69rq\"" Sep 17 19:14:31.370686 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.370655 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:31.443155 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.443114 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftk47\" (UniqueName: \"kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47\") pod \"authorino-7bcfd8f9cd-cx6lq\" (UID: \"b84970c1-0f2d-402d-b766-32742fe0c39a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:31.544640 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.544543 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftk47\" (UniqueName: \"kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47\") pod \"authorino-7bcfd8f9cd-cx6lq\" (UID: \"b84970c1-0f2d-402d-b766-32742fe0c39a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:31.553314 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.553280 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftk47\" (UniqueName: \"kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47\") pod \"authorino-7bcfd8f9cd-cx6lq\" (UID: \"b84970c1-0f2d-402d-b766-32742fe0c39a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:31.586106 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.586066 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:31.854521 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:31.854496 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:31.857075 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:14:31.857042 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb84970c1_0f2d_402d_b766_32742fe0c39a.slice/crio-dd480d7a0e6523186e1f53883b3dc7b582cf4557722d9a26c936948aa0d1f02d WatchSource:0}: Error finding container dd480d7a0e6523186e1f53883b3dc7b582cf4557722d9a26c936948aa0d1f02d: Status 404 returned error can't find the container with id dd480d7a0e6523186e1f53883b3dc7b582cf4557722d9a26c936948aa0d1f02d Sep 17 19:14:32.083856 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:32.083823 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" event={"ID":"b84970c1-0f2d-402d-b766-32742fe0c39a","Type":"ContainerStarted","Data":"dd480d7a0e6523186e1f53883b3dc7b582cf4557722d9a26c936948aa0d1f02d"} Sep 17 19:14:34.093273 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:34.093234 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" event={"ID":"b84970c1-0f2d-402d-b766-32742fe0c39a","Type":"ContainerStarted","Data":"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea"} Sep 17 19:14:35.114094 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:35.114042 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" podStartSLOduration=1.958446614 podStartE2EDuration="4.114026246s" totalImagesPullingTime="2.155579632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:14:35.113028607 +0000 UTC m=+484.173880235" watchObservedRunningTime="2026-09-17 19:14:35.114026246 +0000 UTC m=+484.174877873" Sep 17 19:14:35.357259 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:35.357220 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:36.101233 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:36.101191 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" podUID="b84970c1-0f2d-402d-b766-32742fe0c39a" containerName="authorino" containerID="cri-o://587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea" gracePeriod=30 Sep 17 19:14:36.337807 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:36.337779 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:36.380436 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:36.380310 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftk47\" (UniqueName: \"kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47\") pod \"b84970c1-0f2d-402d-b766-32742fe0c39a\" (UID: \"b84970c1-0f2d-402d-b766-32742fe0c39a\") " Sep 17 19:14:36.382501 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:36.382471 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47" (OuterVolumeSpecName: "kube-api-access-ftk47") pod "b84970c1-0f2d-402d-b766-32742fe0c39a" (UID: "b84970c1-0f2d-402d-b766-32742fe0c39a"). InnerVolumeSpecName "kube-api-access-ftk47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:14:36.481841 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:36.481807 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftk47\" (UniqueName: \"kubernetes.io/projected/b84970c1-0f2d-402d-b766-32742fe0c39a-kube-api-access-ftk47\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:14:37.105720 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.105682 2588 generic.go:356] "Generic (PLEG): container finished" podID="b84970c1-0f2d-402d-b766-32742fe0c39a" containerID="587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea" exitCode=0 Sep 17 19:14:37.105720 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.105718 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" Sep 17 19:14:37.105935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.105728 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" event={"ID":"b84970c1-0f2d-402d-b766-32742fe0c39a","Type":"ContainerDied","Data":"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea"} Sep 17 19:14:37.105935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.105767 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-cx6lq" event={"ID":"b84970c1-0f2d-402d-b766-32742fe0c39a","Type":"ContainerDied","Data":"dd480d7a0e6523186e1f53883b3dc7b582cf4557722d9a26c936948aa0d1f02d"} Sep 17 19:14:37.105935 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.105785 2588 scope.go:117] "RemoveContainer" containerID="587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea" Sep 17 19:14:37.114138 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.114114 2588 scope.go:117] "RemoveContainer" containerID="587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea" Sep 17 19:14:37.114446 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:14:37.114423 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea\": container with ID starting with 587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea not found: ID does not exist" containerID="587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea" Sep 17 19:14:37.114527 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.114453 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea"} err="failed to get container status \"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea\": rpc error: code = NotFound desc = could not find container \"587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea\": container with ID starting with 587be709e9a3e6550a874f331f8d81f2ad5fb40cfb5d561c5fa5955b010009ea not found: ID does not exist" Sep 17 19:14:37.125111 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.125084 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:37.128853 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:37.128828 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-cx6lq"] Sep 17 19:14:39.122215 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:39.122186 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84970c1-0f2d-402d-b766-32742fe0c39a" path="/var/lib/kubelet/pods/b84970c1-0f2d-402d-b766-32742fe0c39a/volumes" Sep 17 19:14:50.632574 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:50.632534 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:51.123162 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:51.123129 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:58.723461 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:58.723425 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:14:58.821080 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:14:58.821042 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:12.756267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.756232 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx"] Sep 17 19:15:12.756759 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.756543 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84970c1-0f2d-402d-b766-32742fe0c39a" containerName="authorino" Sep 17 19:15:12.756759 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.756554 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84970c1-0f2d-402d-b766-32742fe0c39a" containerName="authorino" Sep 17 19:15:12.756759 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.756629 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84970c1-0f2d-402d-b766-32742fe0c39a" containerName="authorino" Sep 17 19:15:12.760479 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.760462 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.764104 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.764081 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 19:15:12.764291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.764107 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wb887\"" Sep 17 19:15:12.764404 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.764336 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 19:15:12.764404 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.764381 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 19:15:12.772710 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.772687 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx"] Sep 17 19:15:12.870299 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870259 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870497 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870314 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870497 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870348 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870497 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870394 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870497 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870484 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870655 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870522 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwjwh\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-kube-api-access-zwjwh\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.870655 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.870545 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971093 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971056 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971093 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971096 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwjwh\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-kube-api-access-zwjwh\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971114 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971139 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971168 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971189 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.971378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.971208 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.972068 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.972038 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.973665 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.973637 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.973767 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.973698 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.973767 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.973726 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.973850 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.973791 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.979975 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.979944 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwjwh\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-kube-api-access-zwjwh\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:12.980110 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:12.980088 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7692cbb-fa3d-465e-9b7b-b1b6a340068a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-gx8jx\" (UID: \"d7692cbb-fa3d-465e-9b7b-b1b6a340068a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:13.069638 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:13.069544 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:13.372750 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:13.372721 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx"] Sep 17 19:15:13.375531 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:15:13.375506 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7692cbb_fa3d_465e_9b7b_b1b6a340068a.slice/crio-9046005c0c46c6464f2134b7b00624b457b68ff9f3f47f52520f975d9d875bfe WatchSource:0}: Error finding container 9046005c0c46c6464f2134b7b00624b457b68ff9f3f47f52520f975d9d875bfe: Status 404 returned error can't find the container with id 9046005c0c46c6464f2134b7b00624b457b68ff9f3f47f52520f975d9d875bfe Sep 17 19:15:14.256844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:14.256756 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" event={"ID":"d7692cbb-fa3d-465e-9b7b-b1b6a340068a","Type":"ContainerStarted","Data":"9046005c0c46c6464f2134b7b00624b457b68ff9f3f47f52520f975d9d875bfe"} Sep 17 19:15:15.144635 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:15.144596 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:15.659040 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:15.658997 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:15:15.659301 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:15.659081 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:15:16.267869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:16.267827 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" event={"ID":"d7692cbb-fa3d-465e-9b7b-b1b6a340068a","Type":"ContainerStarted","Data":"4020d302f80390f9c0245fdb2ab7d776d2410ff36ebc0b32f053f6116cca8b16"} Sep 17 19:15:16.268086 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:16.268059 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:16.270005 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:16.269973 2588 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-gx8jx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 17 19:15:16.270140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:16.270032 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" podUID="d7692cbb-fa3d-465e-9b7b-b1b6a340068a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 19:15:16.293303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:16.293235 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" podStartSLOduration=2.012392263 podStartE2EDuration="4.293212012s" totalImagesPullingTime="2.280819749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:15:16.291851535 +0000 UTC m=+525.352703164" watchObservedRunningTime="2026-09-17 19:15:16.293212012 +0000 UTC m=+525.354063642" Sep 17 19:15:17.272740 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:17.272711 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-gx8jx" Sep 17 19:15:25.327695 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:25.327655 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:25.404960 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:25.404925 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:25.482090 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:25.482055 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:25.560449 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:25.560412 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:25.878249 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:25.878213 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:26.000680 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:26.000641 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:26.098663 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:26.098630 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:34.286191 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:34.286145 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:34.358592 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:34.358560 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:50.096591 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:50.096553 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:15:57.445897 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:15:57.445858 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:16:43.275698 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:16:43.275654 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:16:44.843908 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:16:44.843837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:16:53.310081 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:16:53.310046 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:16:53.411183 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:16:53.411143 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:17:46.858705 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:17:46.858673 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:18.157420 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:18.157317 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:18.259132 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:18.259090 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:31.307603 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:31.307568 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:31.411732 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:31.411696 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:40.431095 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:40.431052 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:40.512365 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:40.512316 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:42.902905 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:42.902869 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:43.415134 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:43.415092 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:48.810028 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:48.809994 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:18:52.905336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:52.905296 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": read tcp 10.133.0.2:54886->10.133.0.19:15021: read: connection reset by peer" start-of-body= Sep 17 19:18:52.905831 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:52.905435 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": read tcp 10.133.0.2:54886->10.133.0.19:15021: read: connection reset by peer" Sep 17 19:18:53.127151 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.127067 2588 generic.go:356] "Generic (PLEG): container finished" podID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerID="d60caf71b40e9ff275c5d7d5c0dc01f6a139533e9c45300d3b90547dd5e5a10c" exitCode=0 Sep 17 19:18:53.127151 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.127137 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" event={"ID":"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2","Type":"ContainerDied","Data":"d60caf71b40e9ff275c5d7d5c0dc01f6a139533e9c45300d3b90547dd5e5a10c"} Sep 17 19:18:53.127569 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.127552 2588 scope.go:117] "RemoveContainer" containerID="d60caf71b40e9ff275c5d7d5c0dc01f6a139533e9c45300d3b90547dd5e5a10c" Sep 17 19:18:53.128493 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.128467 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:18:53.128548 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.128535 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:18:53.128583 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:53.128565 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:18:54.133186 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:54.133153 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" event={"ID":"b3bd6da9-f6b3-44eb-90a3-42e42196e0c2","Type":"ContainerStarted","Data":"9eb197f63365a97fe5f755db2ef74baebeb197cd8635d01ad9dd64beb130b28b"} Sep 17 19:18:54.792394 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:54.792278 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:18:54.792394 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:54.792328 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Sep 17 19:18:54.792670 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:54.792412 2588 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Sep 17 19:18:55.792746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:55.792705 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Sep 17 19:18:55.793140 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:55.792765 2588 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Sep 17 19:18:56.792410 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:56.792337 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Sep 17 19:18:56.792622 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:56.792434 2588 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Sep 17 19:18:57.792753 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:57.792708 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Sep 17 19:18:57.793154 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:57.792780 2588 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Sep 17 19:18:58.792331 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:58.792278 2588 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body= Sep 17 19:18:58.792573 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:58.792377 2588 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" podUID="b3bd6da9-f6b3-44eb-90a3-42e42196e0c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" Sep 17 19:18:59.795847 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:59.795813 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:18:59.796247 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:59.796059 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:18:59.796728 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:18:59.796710 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb" Sep 17 19:19:16.633586 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:16.633547 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:16.875957 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:16.875925 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:27.496901 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:27.496867 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:37.566845 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:37.566792 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:41.650461 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:41.650423 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:41.742931 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:41.742886 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:55.032979 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:55.032887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:19:55.149527 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:19:55.149487 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:10.838720 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:10.838677 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:30.668228 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:30.668192 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:30.771006 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:30.770973 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:34.995064 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:34.995029 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:35.214298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:35.214263 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:38.564202 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:38.564161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:44.423422 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:44.423376 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:44.518305 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:44.518275 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:44.711153 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:44.711027 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:45.085366 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:45.085312 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:45.184929 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:45.184897 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:52.010218 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:52.010185 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:58.136367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:58.136326 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:20:58.238411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:20:58.238375 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:02.509398 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:02.509363 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:02.774176 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:02.774075 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:09.324532 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:09.324496 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:13.173916 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:13.173877 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:13.260195 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:13.260158 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:41.299797 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:41.299763 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:21:41.377126 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:21:41.377092 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:02.367846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:02.367812 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:03.851234 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:03.851200 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:09.060505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:09.060459 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:09.481892 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:09.481854 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:09.689530 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:09.689493 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:14.952577 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:14.952531 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:15.024697 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:15.024660 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:19.818519 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:19.818476 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:31.338791 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:31.338749 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:31.442672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:31.442629 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:31.628327 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:31.628276 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:31.731494 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:31.731462 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:35.270899 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:35.270858 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:37.761236 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:37.761193 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:43.648348 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:43.648283 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:43.715287 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:43.715253 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:45.891307 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:45.891271 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.032120 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.032089 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.132408 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.132374 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.233953 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.233916 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.313431 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.313186 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:22:48.316492 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.316468 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.319090 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.319058 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"router-gateway-1-openshift-default-dockercfg-ln28z\"" Sep 17 19:22:48.319303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.319276 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"kube-root-ca.crt\"" Sep 17 19:22:48.319538 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.319516 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-gw-ca-root-cert\"" Sep 17 19:22:48.319644 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.319527 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-service-ca.crt\"" Sep 17 19:22:48.329794 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.329767 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:22:48.364606 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.364561 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.410863 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.410830 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.410931 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.410967 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6fr\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.410991 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.411020 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411048 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.411035 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.411054 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.411098 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.411221 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.411130 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.489501 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.489458 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:48.511578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511532 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.511747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511606 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6fr\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.511747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511639 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.511747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511682 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.511747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511706 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.511747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511736 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512028 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511761 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512028 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511783 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512028 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.511811 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512202 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.512177 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512525 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.512497 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.512563 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.512573 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.512743 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.512692 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.513963 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.513935 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.514291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.514271 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.522709 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.522674 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.522827 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.522727 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6fr\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr\") pod \"router-gateway-1-openshift-default-7dcbd489bd-fvnt2\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.628843 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.628761 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:48.931513 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.930504 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:22:48.936758 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.936719 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:22:48.936855 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.936803 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:22:48.936855 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:48.936842 2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 17 19:22:49.060486 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:49.060449 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" event={"ID":"ca0654ef-07b3-456f-924d-0ba46c58d1f4","Type":"ContainerStarted","Data":"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa"} Sep 17 19:22:49.060972 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:49.060504 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" event={"ID":"ca0654ef-07b3-456f-924d-0ba46c58d1f4","Type":"ContainerStarted","Data":"e1b6f04c6388756868fa72ec999ec347ebeff9cce4421d9b561bd7969db92800"} Sep 17 19:22:49.082365 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:49.082299 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" podStartSLOduration=1.082279769 podStartE2EDuration="1.082279769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:22:49.079967131 +0000 UTC m=+978.140818762" watchObservedRunningTime="2026-09-17 19:22:49.082279769 +0000 UTC m=+978.143131398" Sep 17 19:22:49.629854 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:49.629813 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:49.634779 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:49.634753 2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:50.064981 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:50.064950 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:50.065800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:50.065778 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:22:51.120664 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:51.120628 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:53.102578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:53.102540 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:53.672233 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:53.672196 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:58.546869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:58.546833 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:22:59.405051 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:22:59.405014 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:04.910053 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:04.910016 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:05.503287 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:05.503249 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:05.578061 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:05.578029 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:06.495079 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:06.495037 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:08.601498 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:08.601455 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:08.679590 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:08.679556 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:09.498684 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:09.498639 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:09.891614 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:09.891523 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:10.006269 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:10.006236 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:10.100080 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:10.100036 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:14.971971 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:14.971935 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:23:14.972423 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:14.972161 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" podUID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" containerName="istio-proxy" containerID="cri-o://8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa" gracePeriod=30 Sep 17 19:23:15.069658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:15.069610 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:16.010332 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.010301 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:16.219104 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.219061 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:16.616481 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.616456 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:23:16.760131 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760095 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760151 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760192 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760217 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760336 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760264 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760340 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760422 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760455 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg6fr\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760478 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data\") pod \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\" (UID: \"ca0654ef-07b3-456f-924d-0ba46c58d1f4\") " Sep 17 19:23:16.760779 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760642 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:23:16.760779 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760687 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:23:16.760877 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760774 2588 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.760877 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760825 2588 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-workload-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.760969 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760850 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:23:16.760969 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.760918 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:23:16.761242 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.761217 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 19:23:16.762852 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.762779 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 17 19:23:16.763111 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.763078 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 19:23:16.763200 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.763108 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr" (OuterVolumeSpecName: "kube-api-access-tg6fr") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "kube-api-access-tg6fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:23:16.763200 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.763120 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca0654ef-07b3-456f-924d-0ba46c58d1f4" (UID: "ca0654ef-07b3-456f-924d-0ba46c58d1f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:23:16.861676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861632 2588 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-credential-socket\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.861676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861669 2588 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-podinfo\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.861676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861678 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg6fr\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-kube-api-access-tg6fr\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.861676 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861687 2588 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-data\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.862055 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861695 2588 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-token\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.862055 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861702 2588 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istiod-ca-cert\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:16.862055 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:16.861709 2588 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0654ef-07b3-456f-924d-0ba46c58d1f4-istio-envoy\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:23:17.180824 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.180793 2588 generic.go:356] "Generic (PLEG): container finished" podID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" containerID="8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa" exitCode=0 Sep 17 19:23:17.181272 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.180832 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" Sep 17 19:23:17.181272 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.180850 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" event={"ID":"ca0654ef-07b3-456f-924d-0ba46c58d1f4","Type":"ContainerDied","Data":"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa"} Sep 17 19:23:17.181272 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.180899 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2" event={"ID":"ca0654ef-07b3-456f-924d-0ba46c58d1f4","Type":"ContainerDied","Data":"e1b6f04c6388756868fa72ec999ec347ebeff9cce4421d9b561bd7969db92800"} Sep 17 19:23:17.181272 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.180922 2588 scope.go:117] "RemoveContainer" containerID="8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa" Sep 17 19:23:17.189728 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.189706 2588 scope.go:117] "RemoveContainer" containerID="8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa" Sep 17 19:23:17.190068 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:23:17.190043 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa\": container with ID starting with 8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa not found: ID does not exist" containerID="8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa" Sep 17 19:23:17.190134 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.190077 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa"} err="failed to get container status \"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa\": rpc error: code = NotFound desc = could not find container \"8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa\": container with ID starting with 8f50efca9b4d6db3f8931fd8769db6acb8fcb9326671925c2682bbbba757d6aa not found: ID does not exist" Sep 17 19:23:17.200889 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.200860 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:23:17.205555 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:17.205526 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-fvnt2"] Sep 17 19:23:19.122251 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:19.122212 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" path="/var/lib/kubelet/pods/ca0654ef-07b3-456f-924d-0ba46c58d1f4/volumes" Sep 17 19:23:20.887044 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:20.887011 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:21.416387 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:21.416340 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:25.887966 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:25.887923 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:27.468541 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:27.468505 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:27.834374 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:27.834326 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:27.909019 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:27.908984 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:56.141630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:56.141589 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:23:56.242308 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:23:56.242271 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:02.388209 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:02.388149 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:04.055718 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:04.055673 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:04.280303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:04.280267 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:08.489269 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:08.489236 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:08.561007 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:08.560969 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:22.623423 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:22.623306 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:39.051312 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:39.051260 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:39.145864 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:39.145832 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:24:39.295810 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:24:39.295776 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:12.376267 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:12.376231 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:29.049770 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:29.049722 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:29.143568 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:29.143532 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:35.652477 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:35.652434 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:37.358441 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:37.358405 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:37.562527 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:37.562495 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:37.638188 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:37.638095 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:41.810467 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:41.810418 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:41.910167 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:41.910126 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:25:56.910113 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:25:56.910017 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:26:13.313679 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:26:13.313640 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:26:13.395164 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:26:13.395128 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:26:23.968008 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:26:23.967962 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:06.634541 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:06.634504 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:08.029045 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:08.029006 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:08.653284 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:08.653249 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:08.739856 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:08.739815 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:55.830704 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:55.830665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:55.992473 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:55.992432 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:57.934849 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:57.934816 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:27:58.069823 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:27:58.069788 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:02.317087 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:02.317045 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:05.220137 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:05.220100 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:08.554639 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:08.554599 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:08.720445 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:08.720399 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:10.220615 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:10.220584 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:10.431819 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:10.431782 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:12.651439 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:12.651395 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:12.748836 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:12.748794 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:31.263407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:31.263371 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:44.022481 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:44.022389 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:44.274770 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:44.274691 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:44.370305 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:44.370269 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:28:59.798244 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:28:59.798202 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:29:21.484962 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:29:21.484922 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:29:21.561550 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:29:21.561511 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:11.407632 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:11.407594 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:11.497077 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:11.497036 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:18.011081 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:18.010988 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:19.762224 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:19.762186 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:20.016660 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:20.016564 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:20.107955 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:20.107906 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:22.780378 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:22.780327 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:22.875947 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:22.875917 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:24.579784 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:24.579731 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:24.680883 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:24.680850 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:26.927345 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:26.927313 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:58.261536 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:58.261496 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:30:58.361507 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:30:58.361471 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:11.959591 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:11.959549 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:12.056058 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:12.056019 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:18.160295 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:18.160256 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:24.057213 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:24.057156 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:24.157759 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:24.157719 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:26.989906 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:26.989872 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:27.218111 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:27.218065 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:34.292910 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:34.292864 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:34.369190 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:34.369155 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:38.700754 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:38.700717 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:40.188268 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:40.188229 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:47.561143 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:47.561055 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:47.656178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:47.656142 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:53.181496 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:53.181443 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:53.452240 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:53.452145 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:31:54.277746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:31:54.277707 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:00.058185 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:00.058149 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:00.123721 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:00.123665 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:20.955872 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:20.955820 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:27.758722 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:27.758691 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:27.855151 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:27.855114 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:48.854800 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:48.854757 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:57.350997 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:57.350953 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:32:57.410266 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:32:57.410229 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:17.591322 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:17.591229 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:17.691806 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:17.691774 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:18.245138 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:18.245099 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:18.346470 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:18.346416 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:23.852646 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:23.852614 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:28.192961 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:28.192929 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:28.411310 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:28.411273 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:31.345669 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:31.345635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:31.517462 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:31.517431 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:37.387836 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:37.387799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:43.696271 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:43.696234 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:33:43.754247 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:33:43.754217 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:05.395117 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.395080 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:05.671038 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.670945 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:34:05.671480 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.671462 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" containerName="istio-proxy" Sep 17 19:34:05.671533 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.671484 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" containerName="istio-proxy" Sep 17 19:34:05.671569 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.671556 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0654ef-07b3-456f-924d-0ba46c58d1f4" containerName="istio-proxy" Sep 17 19:34:05.674809 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.674784 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.677517 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.677488 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\"" Sep 17 19:34:05.678467 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.678437 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\"" Sep 17 19:34:05.678883 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.678861 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-6b85s\"" Sep 17 19:34:05.679063 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.678950 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\"" Sep 17 19:34:05.679139 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.678950 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-rv2z9\"" Sep 17 19:34:05.682961 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.682927 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:34:05.699501 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.699463 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:05.737157 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.737122 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.737435 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.737249 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5jcv\" (UniqueName: \"kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.838323 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.838285 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5jcv\" (UniqueName: \"kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.838546 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.838376 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.841034 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.841007 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.846585 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.846561 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5jcv\" (UniqueName: \"kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:05.988342 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:05.988298 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:06.265303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:06.265252 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:34:06.268533 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:34:06.267814 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451d33bf_e675_4d80_a197_af8d5a3462a4.slice/crio-090fbc4f411a4deb207a9154a283b0eb057b3d9d81df36d2574423e12462af28 WatchSource:0}: Error finding container 090fbc4f411a4deb207a9154a283b0eb057b3d9d81df36d2574423e12462af28: Status 404 returned error can't find the container with id 090fbc4f411a4deb207a9154a283b0eb057b3d9d81df36d2574423e12462af28 Sep 17 19:34:06.270951 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:06.270929 2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 19:34:06.743379 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:06.743328 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" event={"ID":"451d33bf-e675-4d80-a197-af8d5a3462a4","Type":"ContainerStarted","Data":"090fbc4f411a4deb207a9154a283b0eb057b3d9d81df36d2574423e12462af28"} Sep 17 19:34:09.758131 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:09.758098 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" event={"ID":"451d33bf-e675-4d80-a197-af8d5a3462a4","Type":"ContainerStarted","Data":"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390"} Sep 17 19:34:09.758542 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:09.758234 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:09.784905 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:09.784850 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podStartSLOduration=2.231161655 podStartE2EDuration="4.784832712s" totalImagesPullingTime="2.553671057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:34:09.783501868 +0000 UTC m=+1658.844353498" watchObservedRunningTime="2026-09-17 19:34:09.784832712 +0000 UTC m=+1658.845684340" Sep 17 19:34:17.677116 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:17.677074 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:33.784265 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:33.784226 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:33.881265 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:33.881233 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:34.055672 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:34.055582 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:34.150167 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:34.150133 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:37.671183 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:37.671143 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:40.400134 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:40.400099 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:40.763852 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:40.763825 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:34:45.483947 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:45.483869 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:46.905468 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:46.905433 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:47.005972 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:47.005941 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:53.431958 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:53.431920 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:34:53.445704 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:53.445674 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:34:53.531162 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:34:53.531131 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:35:00.764063 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:00.764017 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:35:06.571180 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:06.571140 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:35:08.465976 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:08.465923 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" containerID="cri-o://8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390" gracePeriod=45 Sep 17 19:35:10.763686 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:10.763646 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:35:20.764262 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:20.764228 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:35:20.764680 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:20.764334 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:35:30.763639 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:30.763603 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:35:38.723417 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.723332 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:35:38.816703 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.816662 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs\") pod \"451d33bf-e675-4d80-a197-af8d5a3462a4\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " Sep 17 19:35:38.816703 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.816703 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5jcv\" (UniqueName: \"kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv\") pod \"451d33bf-e675-4d80-a197-af8d5a3462a4\" (UID: \"451d33bf-e675-4d80-a197-af8d5a3462a4\") " Sep 17 19:35:38.819024 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.818978 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv" (OuterVolumeSpecName: "kube-api-access-g5jcv") pod "451d33bf-e675-4d80-a197-af8d5a3462a4" (UID: "451d33bf-e675-4d80-a197-af8d5a3462a4"). InnerVolumeSpecName "kube-api-access-g5jcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:35:38.819024 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.818984 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "451d33bf-e675-4d80-a197-af8d5a3462a4" (UID: "451d33bf-e675-4d80-a197-af8d5a3462a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:35:38.917448 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.917416 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/451d33bf-e675-4d80-a197-af8d5a3462a4-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:35:38.917448 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:38.917443 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5jcv\" (UniqueName: \"kubernetes.io/projected/451d33bf-e675-4d80-a197-af8d5a3462a4-kube-api-access-g5jcv\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:35:39.110987 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.110948 2588 generic.go:356] "Generic (PLEG): container finished" podID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerID="8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390" exitCode=0 Sep 17 19:35:39.111168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.111004 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" Sep 17 19:35:39.111168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.111037 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" event={"ID":"451d33bf-e675-4d80-a197-af8d5a3462a4","Type":"ContainerDied","Data":"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390"} Sep 17 19:35:39.111168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.111093 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q" event={"ID":"451d33bf-e675-4d80-a197-af8d5a3462a4","Type":"ContainerDied","Data":"090fbc4f411a4deb207a9154a283b0eb057b3d9d81df36d2574423e12462af28"} Sep 17 19:35:39.111168 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.111116 2588 scope.go:117] "RemoveContainer" containerID="8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390" Sep 17 19:35:39.119906 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.119888 2588 scope.go:117] "RemoveContainer" containerID="8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390" Sep 17 19:35:39.120206 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:35:39.120187 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390\": container with ID starting with 8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390 not found: ID does not exist" containerID="8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390" Sep 17 19:35:39.120255 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.120215 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390"} err="failed to get container status \"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390\": rpc error: code = NotFound desc = could not find container \"8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390\": container with ID starting with 8d323583aefb352e278b03cc8dcd777277d828f0be25cda65cebf80f3bdf2390 not found: ID does not exist" Sep 17 19:35:39.132052 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.132024 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:35:39.134936 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:39.134913 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scher227q"] Sep 17 19:35:41.125932 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:41.125899 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" path="/var/lib/kubelet/pods/451d33bf-e675-4d80-a197-af8d5a3462a4/volumes" Sep 17 19:35:43.076229 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:43.076194 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:35:43.135584 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:43.135551 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:35:57.500251 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:35:57.500189 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:02.484163 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:02.484128 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:02.584317 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:02.584284 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:07.483149 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:07.483112 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:12.618933 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:12.618896 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:12.860105 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:12.860068 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:22.558914 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:22.558834 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:28.578717 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:28.578674 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:29.960636 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:29.960601 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:33.137774 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:33.137738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:33.233189 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:33.233153 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:35.677039 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:35.676991 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:36.095401 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.095341 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:36.293739 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.293709 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:36:36.294018 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.294006 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" Sep 17 19:36:36.294073 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.294019 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" Sep 17 19:36:36.294073 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.294068 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="451d33bf-e675-4d80-a197-af8d5a3462a4" containerName="main" Sep 17 19:36:36.296932 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.296906 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.299609 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.299580 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-jfpzj\"" Sep 17 19:36:36.299733 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.299590 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"kube-root-ca.crt\"" Sep 17 19:36:36.300223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.300209 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"openshift-service-ca.crt\"" Sep 17 19:36:36.300293 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.300279 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\"" Sep 17 19:36:36.300595 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.300582 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-5bc7dccd\"/\"default-dockercfg-547w2\"" Sep 17 19:36:36.309154 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.309122 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:36:36.320421 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.320384 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:36.390547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.390459 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.390547 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.390532 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdnr6\" (UniqueName: \"kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.491162 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.491119 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdnr6\" (UniqueName: \"kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.491345 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.491206 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.493690 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.493661 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.501115 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.501083 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdnr6\" (UniqueName: \"kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.608029 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.607981 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:36.878657 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:36.878628 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:36:36.880701 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:36:36.880674 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e17e4dc_1c98_47d3_afe3_26641fee0103.slice/crio-02ff32a05bf57dd91027d0dc114bbf1f5dd3d1e4fd218e12943545fed06f1c13 WatchSource:0}: Error finding container 02ff32a05bf57dd91027d0dc114bbf1f5dd3d1e4fd218e12943545fed06f1c13: Status 404 returned error can't find the container with id 02ff32a05bf57dd91027d0dc114bbf1f5dd3d1e4fd218e12943545fed06f1c13 Sep 17 19:36:37.346403 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:37.346366 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" event={"ID":"6e17e4dc-1c98-47d3-afe3-26641fee0103","Type":"ContainerStarted","Data":"f34bae3c03e8358fe893ac4d27a8c6b9c05f337874f008333f7c2a603d9ea58b"} Sep 17 19:36:37.346583 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:37.346433 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" event={"ID":"6e17e4dc-1c98-47d3-afe3-26641fee0103","Type":"ContainerStarted","Data":"02ff32a05bf57dd91027d0dc114bbf1f5dd3d1e4fd218e12943545fed06f1c13"} Sep 17 19:36:37.346583 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:37.346460 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:36:40.179927 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:40.179863 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:44.869154 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:44.869115 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:46.183980 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:46.183939 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:46.284833 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:46.284799 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:48.998579 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:48.998538 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:50.604302 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:50.604261 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:36:50.700966 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:36:50.700932 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:37:08.351312 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:37:08.351284 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:37:08.370589 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:37:08.370525 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podStartSLOduration=32.370503733 podStartE2EDuration="32.370503733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:36:37.392114092 +0000 UTC m=+1806.452965720" watchObservedRunningTime="2026-09-17 19:37:08.370503733 +0000 UTC m=+1837.431355364" Sep 17 19:37:27.196938 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:37:27.196901 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:20.732187 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:20.732150 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:20.755802 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:20.755669 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:38:20.810250 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:20.810213 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:22.224747 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:22.224712 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:28.351207 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:28.351169 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:38:35.774906 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:35.774859 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" containerID="cri-o://f34bae3c03e8358fe893ac4d27a8c6b9c05f337874f008333f7c2a603d9ea58b" gracePeriod=45 Sep 17 19:38:38.351365 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:38.351311 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:38:48.202372 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:48.202310 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:48.307869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:48.307831 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:38:48.351696 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:48.351657 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:38:48.351860 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:48.351767 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:38:58.351250 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:38:58.351210 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:39:01.296053 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:01.296004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:05.948821 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:05.948790 2588 generic.go:356] "Generic (PLEG): container finished" podID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerID="f34bae3c03e8358fe893ac4d27a8c6b9c05f337874f008333f7c2a603d9ea58b" exitCode=0 Sep 17 19:39:05.949186 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:05.948863 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" event={"ID":"6e17e4dc-1c98-47d3-afe3-26641fee0103","Type":"ContainerDied","Data":"f34bae3c03e8358fe893ac4d27a8c6b9c05f337874f008333f7c2a603d9ea58b"} Sep 17 19:39:06.016347 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.016322 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:39:06.110276 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.110182 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs\") pod \"6e17e4dc-1c98-47d3-afe3-26641fee0103\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " Sep 17 19:39:06.110276 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.110272 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdnr6\" (UniqueName: \"kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6\") pod \"6e17e4dc-1c98-47d3-afe3-26641fee0103\" (UID: \"6e17e4dc-1c98-47d3-afe3-26641fee0103\") " Sep 17 19:39:06.112379 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.112327 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6" (OuterVolumeSpecName: "kube-api-access-mdnr6") pod "6e17e4dc-1c98-47d3-afe3-26641fee0103" (UID: "6e17e4dc-1c98-47d3-afe3-26641fee0103"). InnerVolumeSpecName "kube-api-access-mdnr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:39:06.112490 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.112379 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6e17e4dc-1c98-47d3-afe3-26641fee0103" (UID: "6e17e4dc-1c98-47d3-afe3-26641fee0103"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:39:06.211137 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.211100 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdnr6\" (UniqueName: \"kubernetes.io/projected/6e17e4dc-1c98-47d3-afe3-26641fee0103-kube-api-access-mdnr6\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:39:06.211137 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.211132 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e17e4dc-1c98-47d3-afe3-26641fee0103-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:39:06.954218 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.954177 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" event={"ID":"6e17e4dc-1c98-47d3-afe3-26641fee0103","Type":"ContainerDied","Data":"02ff32a05bf57dd91027d0dc114bbf1f5dd3d1e4fd218e12943545fed06f1c13"} Sep 17 19:39:06.954710 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.954240 2588 scope.go:117] "RemoveContainer" containerID="f34bae3c03e8358fe893ac4d27a8c6b9c05f337874f008333f7c2a603d9ea58b" Sep 17 19:39:06.954710 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.954194 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq" Sep 17 19:39:06.974270 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.974240 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:39:06.978292 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:06.978256 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-5bc7dccd/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schenjvtq"] Sep 17 19:39:07.127796 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:07.127762 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" path="/var/lib/kubelet/pods/6e17e4dc-1c98-47d3-afe3-26641fee0103/volumes" Sep 17 19:39:10.786951 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:10.786920 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:10.877198 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:10.877161 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:17.238865 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:17.238746 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:17.814534 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:17.814489 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:18.019367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:18.019321 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:23.481223 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:23.481184 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:23.546232 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:23.546197 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:29.509879 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:29.509833 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:38.239625 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:38.239587 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:38.342527 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:38.342489 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:41.894219 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:41.894181 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:44.468268 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.468234 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:44.560953 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.560918 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:44.661551 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.661518 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:39:44.661857 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.661844 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" Sep 17 19:39:44.661915 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.661859 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" Sep 17 19:39:44.661953 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.661921 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e17e4dc-1c98-47d3-afe3-26641fee0103" containerName="main" Sep 17 19:39:44.666161 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.666137 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.670007 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.669979 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"default-dockercfg-ln4x2\"" Sep 17 19:39:44.670254 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.670232 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisvc-model-fb-opt-125m-oci-r-0fba19de-epp-sa-dockercfg-jd7h7\"" Sep 17 19:39:44.670326 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.670271 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"kube-root-ca.crt\"" Sep 17 19:39:44.670531 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.670517 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"openshift-service-ca.crt\"" Sep 17 19:39:44.670641 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.670615 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7bc4bd10\"/\"llmisv20d1e8ef181cac7effb0fab7b8590b15-kserve-self-signed-certs\"" Sep 17 19:39:44.679147 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.679121 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:39:44.704315 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.704282 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:44.845182 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.845145 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.845401 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.845221 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rwk\" (UniqueName: \"kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.946279 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.946235 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rwk\" (UniqueName: \"kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.946528 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.946289 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.948806 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.948783 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.955008 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.954962 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rwk\" (UniqueName: \"kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk\") pod \"llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:44.977878 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:44.977838 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:45.249424 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:45.249393 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:39:45.252272 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:39:45.252244 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f16b32_05de_48d4_af0d_d0efbd0a6c33.slice/crio-934bd7a543f3de1eef02e6fd278f3207f8dc025db20839bcaf8c122ea4cd439d WatchSource:0}: Error finding container 934bd7a543f3de1eef02e6fd278f3207f8dc025db20839bcaf8c122ea4cd439d: Status 404 returned error can't find the container with id 934bd7a543f3de1eef02e6fd278f3207f8dc025db20839bcaf8c122ea4cd439d Sep 17 19:39:46.113712 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:46.113681 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" event={"ID":"50f16b32-05de-48d4-af0d-d0efbd0a6c33","Type":"ContainerStarted","Data":"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405"} Sep 17 19:39:46.114126 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:46.113733 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" event={"ID":"50f16b32-05de-48d4-af0d-d0efbd0a6c33","Type":"ContainerStarted","Data":"934bd7a543f3de1eef02e6fd278f3207f8dc025db20839bcaf8c122ea4cd439d"} Sep 17 19:39:46.114126 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:46.113794 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:39:46.129870 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:46.129822 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podStartSLOduration=2.129803897 podStartE2EDuration="2.129803897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:39:46.128221459 +0000 UTC m=+1995.189073087" watchObservedRunningTime="2026-09-17 19:39:46.129803897 +0000 UTC m=+1995.190655525" Sep 17 19:39:50.114391 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:50.114340 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:50.177901 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:50.177862 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:39:52.539814 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:39:52.539777 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:40:17.122255 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:40:17.122222 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:40:39.572199 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:40:39.572156 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:40:39.632780 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:40:39.632744 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:29.153239 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:29.153201 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:29.249243 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:29.249201 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:33.852321 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:33.852286 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:34.054339 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:34.054308 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:37.208322 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:37.208278 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:40.572304 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:40.572253 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:43.027637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:43.027598 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:43.095629 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:43.095588 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:59.529978 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:59.529903 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:41:59.556817 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:59.556782 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:41:59.620921 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:41:59.620887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:42:07.120915 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:07.120865 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:42:14.576412 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:14.576304 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" containerID="cri-o://4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405" gracePeriod=45 Sep 17 19:42:17.119808 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:17.119766 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:42:27.119794 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:27.119753 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:42:27.122439 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:27.122416 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:42:37.119967 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:37.119925 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:42:44.829303 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.829272 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:42:44.838573 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.838494 2588 generic.go:356] "Generic (PLEG): container finished" podID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerID="4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405" exitCode=0 Sep 17 19:42:44.838573 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.838539 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" Sep 17 19:42:44.838742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.838572 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" event={"ID":"50f16b32-05de-48d4-af0d-d0efbd0a6c33","Type":"ContainerDied","Data":"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405"} Sep 17 19:42:44.838742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.838614 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv" event={"ID":"50f16b32-05de-48d4-af0d-d0efbd0a6c33","Type":"ContainerDied","Data":"934bd7a543f3de1eef02e6fd278f3207f8dc025db20839bcaf8c122ea4cd439d"} Sep 17 19:42:44.838742 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.838635 2588 scope.go:117] "RemoveContainer" containerID="4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405" Sep 17 19:42:44.847657 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.847629 2588 scope.go:117] "RemoveContainer" containerID="4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405" Sep 17 19:42:44.848076 ip-10-0-139-216 kubenswrapper[2588]: E0917 19:42:44.848048 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405\": container with ID starting with 4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405 not found: ID does not exist" containerID="4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405" Sep 17 19:42:44.848155 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.848087 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405"} err="failed to get container status \"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405\": rpc error: code = NotFound desc = could not find container \"4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405\": container with ID starting with 4fb1ff427e585b2d1d3400b85c89e926a17f1e1ddaa6a6778e2d52bfd07ab405 not found: ID does not exist" Sep 17 19:42:44.864658 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.864625 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs\") pod \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " Sep 17 19:42:44.864847 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.864828 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5rwk\" (UniqueName: \"kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk\") pod \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\" (UID: \"50f16b32-05de-48d4-af0d-d0efbd0a6c33\") " Sep 17 19:42:44.866818 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.866784 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "50f16b32-05de-48d4-af0d-d0efbd0a6c33" (UID: "50f16b32-05de-48d4-af0d-d0efbd0a6c33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:42:44.866950 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.866869 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk" (OuterVolumeSpecName: "kube-api-access-f5rwk") pod "50f16b32-05de-48d4-af0d-d0efbd0a6c33" (UID: "50f16b32-05de-48d4-af0d-d0efbd0a6c33"). InnerVolumeSpecName "kube-api-access-f5rwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:42:44.965483 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.965446 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f16b32-05de-48d4-af0d-d0efbd0a6c33-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:42:44.965483 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:44.965474 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5rwk\" (UniqueName: \"kubernetes.io/projected/50f16b32-05de-48d4-af0d-d0efbd0a6c33-kube-api-access-f5rwk\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:42:45.153832 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:45.153797 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:42:45.158383 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:45.158344 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7bc4bd10/llmisvc20d1e8ef181cac7effb0fab7b8590b15-kserve-router-schedn6lv"] Sep 17 19:42:47.123238 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:47.123205 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" path="/var/lib/kubelet/pods/50f16b32-05de-48d4-af0d-d0efbd0a6c33/volumes" Sep 17 19:42:49.540682 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:49.540644 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:42:50.559997 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:50.559954 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:42:55.586523 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:55.586487 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:42:55.847204 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:55.847107 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:42:56.277240 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:42:56.277207 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:02.171505 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:02.171452 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:02.270698 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:02.270658 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:06.377804 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:06.377760 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:35.967811 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:35.967677 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:36.063633 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:36.063599 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:43:36.165396 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:43:36.165362 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:44:19.705020 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.704979 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:44:19.832377 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.832332 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:44:19.832684 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.832669 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" Sep 17 19:44:19.832730 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.832687 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" Sep 17 19:44:19.832765 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.832737 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f16b32-05de-48d4-af0d-d0efbd0a6c33" containerName="main" Sep 17 19:44:19.836138 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.836117 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:19.838564 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.838541 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\"" Sep 17 19:44:19.839495 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.839479 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\"" Sep 17 19:44:19.839568 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.839537 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-kdp96\"" Sep 17 19:44:19.839568 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.839563 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\"" Sep 17 19:44:19.839678 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.839660 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-5zt5s\"" Sep 17 19:44:19.847765 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.847740 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:44:19.904710 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.904672 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:44:19.963715 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.963616 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvl8s\" (UniqueName: \"kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:19.963875 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:19.963737 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.065152 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.065112 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.065337 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.065170 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvl8s\" (UniqueName: \"kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.068006 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.067968 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.075904 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.075878 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvl8s\" (UniqueName: \"kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.147234 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.147196 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:20.422237 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:20.422202 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:44:20.426565 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:44:20.426534 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddaa6a1a_7e33_45c9_950d_6ecb8f4b3a76.slice/crio-c4635032335de805b59cb975e807e4c4d452b8ac7d32bae74af091625ac4f3e1 WatchSource:0}: Error finding container c4635032335de805b59cb975e807e4c4d452b8ac7d32bae74af091625ac4f3e1: Status 404 returned error can't find the container with id c4635032335de805b59cb975e807e4c4d452b8ac7d32bae74af091625ac4f3e1 Sep 17 19:44:21.223212 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:21.223172 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" event={"ID":"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76","Type":"ContainerStarted","Data":"3b052486e8777d09a25452d079d063e855b6dc1c18f5fa98557e7a73c43ffec6"} Sep 17 19:44:21.223630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:21.223225 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" event={"ID":"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76","Type":"ContainerStarted","Data":"c4635032335de805b59cb975e807e4c4d452b8ac7d32bae74af091625ac4f3e1"} Sep 17 19:44:21.223630 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:21.223263 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:44:21.240241 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:21.240186 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podStartSLOduration=2.240167552 podStartE2EDuration="2.240167552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:44:21.238838891 +0000 UTC m=+2270.299690546" watchObservedRunningTime="2026-09-17 19:44:21.240167552 +0000 UTC m=+2270.301019179" Sep 17 19:44:28.976451 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:28.976415 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:44:50.507831 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:50.507794 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:44:52.228804 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:44:52.228776 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:45:00.441261 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:00.441216 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:00.540444 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:00.540407 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:50.503625 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:50.503585 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:50.603334 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:50.603250 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:50.836930 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:50.836898 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:50.906525 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:50.906488 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:53.993622 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:53.993590 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:45:57.832001 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:45:57.831961 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:03.758976 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:03.758939 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:03.859220 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:03.859183 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:05.139066 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:05.139019 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:05.245740 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:05.245700 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:09.477836 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:09.477802 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:09.768834 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:09.768741 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:09.869692 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:09.869655 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:23.678806 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:23.678769 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:46:23.680990 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:23.680961 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:23.777077 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:23.777036 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:46:32.228685 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:32.228648 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:46:38.707805 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:38.707736 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" containerID="cri-o://3b052486e8777d09a25452d079d063e855b6dc1c18f5fa98557e7a73c43ffec6" gracePeriod=45 Sep 17 19:46:42.228666 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:42.228617 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:46:52.229370 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:52.229267 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:46:52.229735 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:46:52.229424 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:47:01.671611 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:01.671576 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:02.229330 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:02.229290 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 19:47:08.892289 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:08.892249 2588 generic.go:356] "Generic (PLEG): container finished" podID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerID="3b052486e8777d09a25452d079d063e855b6dc1c18f5fa98557e7a73c43ffec6" exitCode=0 Sep 17 19:47:08.892716 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:08.892324 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" event={"ID":"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76","Type":"ContainerDied","Data":"3b052486e8777d09a25452d079d063e855b6dc1c18f5fa98557e7a73c43ffec6"} Sep 17 19:47:08.949284 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:08.949258 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:47:09.109635 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.109597 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvl8s\" (UniqueName: \"kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s\") pod \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " Sep 17 19:47:09.109830 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.109663 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs\") pod \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\" (UID: \"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76\") " Sep 17 19:47:09.111869 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.111840 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s" (OuterVolumeSpecName: "kube-api-access-lvl8s") pod "ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" (UID: "ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76"). InnerVolumeSpecName "kube-api-access-lvl8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 19:47:09.112015 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.111893 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" (UID: "ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 19:47:09.210638 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.210605 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvl8s\" (UniqueName: \"kubernetes.io/projected/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-kube-api-access-lvl8s\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:47:09.210638 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.210632 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 19:47:09.899637 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.899610 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" Sep 17 19:47:09.900129 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.899613 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb" event={"ID":"ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76","Type":"ContainerDied","Data":"c4635032335de805b59cb975e807e4c4d452b8ac7d32bae74af091625ac4f3e1"} Sep 17 19:47:09.900129 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.899769 2588 scope.go:117] "RemoveContainer" containerID="3b052486e8777d09a25452d079d063e855b6dc1c18f5fa98557e7a73c43ffec6" Sep 17 19:47:09.916135 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.916109 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:47:09.920465 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:09.920445 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-f4tbb"] Sep 17 19:47:11.122291 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:11.122256 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" path="/var/lib/kubelet/pods/ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76/volumes" Sep 17 19:47:13.026805 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:13.026766 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:13.126455 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:13.126411 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:13.226790 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:13.226759 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:19.487786 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:19.487750 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:23.006165 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:23.006133 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:24.977206 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:24.977170 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:47:25.076724 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:47:25.076659 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:48:14.733422 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:48:14.733314 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:48:15.896068 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:48:15.896028 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:48:41.238986 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:48:41.238932 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:04.739231 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:04.739192 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:04.834308 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:04.834269 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:09.819663 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:09.819629 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:12.582512 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:12.582479 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:12.917089 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:12.917002 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:18.936633 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:18.936601 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:31.651199 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:31.651166 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:33.233090 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:33.233052 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:34.350059 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:34.350022 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:36.176019 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:36.175978 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:39.640891 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:39.640860 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:47.837463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:47.837430 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:54.200546 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:54.200507 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:54.302035 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:54.302004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:54.404724 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:54.404693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:55.244591 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:55.244561 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:49:55.344887 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:49:55.344852 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:00.657846 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:00.657814 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:00.738407 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:00.738373 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:05.010617 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:05.010576 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:19.093569 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:19.093517 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:19.194102 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:19.194053 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:47.416736 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:47.416698 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:50:47.518206 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:50:47.518176 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:51:34.025807 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:51:34.025721 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:51:34.113618 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:51:34.113584 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:51:53.914017 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:51:53.913981 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:14.076541 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:14.076506 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:14.168112 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:14.168081 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:14.268063 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:14.268028 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:14.376998 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:14.376900 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:14.474432 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:14.474397 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:16.735380 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:16.735336 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:16.836763 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:16.836734 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:17.424391 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:17.424338 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:20.497557 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:20.497524 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:20.608666 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:20.608629 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:24.104880 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:24.104845 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:24.220560 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:24.220525 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:30.529764 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:30.529727 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:31.577228 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:31.577188 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:31.835316 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:31.835220 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:37.793578 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:37.793541 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:37.974255 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:37.974220 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:39.115533 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:39.115501 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:52:44.918511 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:52:44.918424 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:53:50.628561 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:53:50.628527 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:54:50.896626 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:54:50.896591 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:54:54.430181 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:54:54.430141 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:54:54.561722 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:54:54.561693 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:07.668661 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:07.668623 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:07.738958 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:07.738916 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:11.131308 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:11.131272 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:11.232746 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:11.232710 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:11.335219 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:11.335187 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:11.448504 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:11.448406 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:11.558920 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:11.558890 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:13.660574 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:13.660545 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:13.726466 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:13.726432 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:14.492210 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:14.492179 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:16.408434 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:16.408397 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:16.512065 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:16.512023 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:16.612644 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:16.612609 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:16.712838 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:16.712754 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:17.529141 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:17.529107 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:23.240900 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:23.240863 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:23.337843 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:23.337810 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:42.376363 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:42.376314 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:44.444335 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:44.444255 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:44.543111 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:44.543076 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:45.033534 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:45.033496 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:45.132766 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:45.132738 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:46.913985 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:46.913955 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:48.339258 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:48.339222 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:51.217919 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:51.217883 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:53.574298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:53.574257 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:53.636405 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:53.636371 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:56.969873 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:56.969831 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:55:57.070948 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:55:57.070918 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:56:42.337479 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:56:42.337440 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:56:42.876411 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:56:42.876378 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:56:42.977844 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:56:42.977805 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:56:53.028026 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:56:53.027947 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:57:40.001862 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:57:40.001823 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:00.094926 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:00.094894 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:00.194655 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:00.194625 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:00.294859 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:00.294830 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:06.224118 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:06.224076 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:06.346420 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:06.346383 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:06.647347 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:06.647316 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:07.594159 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.594125 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:07.813033 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.812997 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 19:58:07.813949 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.813923 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" Sep 17 19:58:07.814109 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.814098 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" Sep 17 19:58:07.814330 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.814317 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddaa6a1a-7e33-45c9-950d-6ecb8f4b3a76" containerName="main" Sep 17 19:58:07.817987 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.817963 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:07.822205 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.822172 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"openshift-service-ca.crt\"" Sep 17 19:58:07.822367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.822226 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"default-dockercfg-m242m\"" Sep 17 19:58:07.822367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.822236 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-kserve-self-signed-certs\"" Sep 17 19:58:07.822367 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.822318 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"kube-root-ca.crt\"" Sep 17 19:58:07.822596 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.822579 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-epp-sa-dockercfg-nglpx\"" Sep 17 19:58:07.826178 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.826151 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 19:58:07.856707 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:07.856620 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:08.003173 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.003129 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.003426 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.003253 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grk76\" (UniqueName: \"kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.104508 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.104469 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grk76\" (UniqueName: \"kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.104725 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.104518 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.107118 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.107062 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.113198 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.113159 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grk76\" (UniqueName: \"kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.131209 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.131177 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.402892 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.402805 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 19:58:08.406430 ip-10-0-139-216 kubenswrapper[2588]: W0917 19:58:08.406394 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b1927c_8ed0_42ce_af67_dfe041842c2d.slice/crio-3f56d3b9326a636cb51cf661b306f9961330f69a50aa977e7f97062b9839f881 WatchSource:0}: Error finding container 3f56d3b9326a636cb51cf661b306f9961330f69a50aa977e7f97062b9839f881: Status 404 returned error can't find the container with id 3f56d3b9326a636cb51cf661b306f9961330f69a50aa977e7f97062b9839f881 Sep 17 19:58:08.513966 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.513923 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" event={"ID":"d0b1927c-8ed0-42ce-af67-dfe041842c2d","Type":"ContainerStarted","Data":"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d"} Sep 17 19:58:08.514188 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.514167 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:58:08.514298 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.514234 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" event={"ID":"d0b1927c-8ed0-42ce-af67-dfe041842c2d","Type":"ContainerStarted","Data":"3f56d3b9326a636cb51cf661b306f9961330f69a50aa977e7f97062b9839f881"} Sep 17 19:58:08.533646 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:08.533586 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podStartSLOduration=1.533565752 podStartE2EDuration="1.533565752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:58:08.532228869 +0000 UTC m=+3097.593080509" watchObservedRunningTime="2026-09-17 19:58:08.533565752 +0000 UTC m=+3097.594417381" Sep 17 19:58:12.361276 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:12.361238 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:12.461441 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:12.461408 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:13.404031 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:13.403978 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:13.502482 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:13.502444 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:14.967189 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:14.967156 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:58:39.520269 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:58:39.520237 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 19:59:01.634463 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:01.634423 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:59:02.804620 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:02.804592 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:59:51.732507 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:51.732470 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:59:51.842091 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:51.842056 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:59:56.733288 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:56.733251 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 19:59:57.711098 ip-10-0-139-216 kubenswrapper[2588]: I0917 19:59:57.711066 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:13.590536 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:13.590499 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 20:00:13.591165 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:13.591095 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:13.688596 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:13.688560 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:18.116814 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:18.116777 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:19.519471 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:19.519438 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:00:19.521836 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:19.521804 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:25.236378 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:25.236317 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:28.610257 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:28.610214 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" containerID="cri-o://7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d" gracePeriod=45 Sep 17 20:00:29.520020 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:29.519980 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:00:39.520263 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:39.520202 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:00:39.520742 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:39.520333 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 20:00:39.562823 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:39.562792 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:40.093500 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:40.093464 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:40.162398 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:40.162343 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:00:49.520109 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:49.520071 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:00:58.854907 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:58.854878 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 20:00:58.906146 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:58.906048 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grk76\" (UniqueName: \"kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76\") pod \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " Sep 17 20:00:58.906322 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:58.906157 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs\") pod \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\" (UID: \"d0b1927c-8ed0-42ce-af67-dfe041842c2d\") " Sep 17 20:00:58.908458 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:58.908429 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0b1927c-8ed0-42ce-af67-dfe041842c2d" (UID: "d0b1927c-8ed0-42ce-af67-dfe041842c2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 20:00:58.908571 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:58.908427 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76" (OuterVolumeSpecName: "kube-api-access-grk76") pod "d0b1927c-8ed0-42ce-af67-dfe041842c2d" (UID: "d0b1927c-8ed0-42ce-af67-dfe041842c2d"). InnerVolumeSpecName "kube-api-access-grk76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 20:00:59.007614 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.007579 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0b1927c-8ed0-42ce-af67-dfe041842c2d-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 20:00:59.007791 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.007631 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grk76\" (UniqueName: \"kubernetes.io/projected/d0b1927c-8ed0-42ce-af67-dfe041842c2d-kube-api-access-grk76\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 20:00:59.191399 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.191290 2588 generic.go:356] "Generic (PLEG): container finished" podID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerID="7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d" exitCode=0 Sep 17 20:00:59.191399 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.191345 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" Sep 17 20:00:59.191399 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.191387 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" event={"ID":"d0b1927c-8ed0-42ce-af67-dfe041842c2d","Type":"ContainerDied","Data":"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d"} Sep 17 20:00:59.191642 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.191446 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp" event={"ID":"d0b1927c-8ed0-42ce-af67-dfe041842c2d","Type":"ContainerDied","Data":"3f56d3b9326a636cb51cf661b306f9961330f69a50aa977e7f97062b9839f881"} Sep 17 20:00:59.191642 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.191469 2588 scope.go:117] "RemoveContainer" containerID="7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d" Sep 17 20:00:59.200295 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.200276 2588 scope.go:117] "RemoveContainer" containerID="7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d" Sep 17 20:00:59.200596 ip-10-0-139-216 kubenswrapper[2588]: E0917 20:00:59.200577 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d\": container with ID starting with 7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d not found: ID does not exist" containerID="7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d" Sep 17 20:00:59.200675 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.200604 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d"} err="failed to get container status \"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d\": rpc error: code = NotFound desc = could not find container \"7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d\": container with ID starting with 7a5b05f9bb06eb81c65eda50e4fe4b8f18184e0257dc4872cc3abc946112d48d not found: ID does not exist" Sep 17 20:00:59.208584 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.208562 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 20:00:59.210343 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:00:59.210321 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-nmpjp"] Sep 17 20:01:01.123046 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:01.123009 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" path="/var/lib/kubelet/pods/d0b1927c-8ed0-42ce-af67-dfe041842c2d/volumes" Sep 17 20:01:04.564723 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:04.564686 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:04.665454 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:04.665412 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:05.906989 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:05.906947 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:06.226134 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:06.226035 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:10.236436 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:10.236403 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:15.959346 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:15.959305 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:16.022721 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:16.022694 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:17.507894 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:17.507859 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:01:29.866804 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:01:29.866769 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:03.650013 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:03.649925 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:12.668716 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:12.668683 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:32.584073 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:32.584041 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:32.677554 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:32.677520 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:39.332644 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:39.332613 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:44.927239 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:44.927204 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:44.996931 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:44.996901 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:50.014095 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:50.014053 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:50.123409 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:50.123336 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:50.293057 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:50.292960 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:02:50.444288 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:02:50.444258 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:03:05.200505 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:03:05.200471 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:03:27.715206 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:03:27.715110 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:03:27.814734 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:03:27.814703 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:03:57.898432 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:03:57.898393 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:32.755500 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:32.755457 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:34.152225 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:34.152179 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:38.997076 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:38.997004 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:40.666808 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.666772 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:40.830025 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.829985 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:04:40.830425 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.830409 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" Sep 17 20:04:40.830425 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.830427 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" Sep 17 20:04:40.830529 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.830487 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b1927c-8ed0-42ce-af67-dfe041842c2d" containerName="main" Sep 17 20:04:40.833582 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.833560 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:40.837252 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.837228 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"kube-root-ca.crt\"" Sep 17 20:04:40.837426 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.837236 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-kserve-self-signed-certs\"" Sep 17 20:04:40.837426 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.837288 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"openshift-service-ca.crt\"" Sep 17 20:04:40.837426 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.837374 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"default-dockercfg-gll76\"" Sep 17 20:04:40.837596 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.837473 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-epp-sa-dockercfg-vf969\"" Sep 17 20:04:40.843427 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.843397 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:04:40.866408 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.866378 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:40.921772 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.921688 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:40.921772 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:40.921723 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7x4\" (UniqueName: \"kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.022546 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.022509 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.022546 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.022546 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7x4\" (UniqueName: \"kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.025134 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.025109 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.030949 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.030912 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7x4\" (UniqueName: \"kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4\") pod \"rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.145824 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.145778 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:41.416310 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:41.416277 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:04:41.419200 ip-10-0-139-216 kubenswrapper[2588]: W0917 20:04:41.419174 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47cd037_d3ba_4a6d_8551_2142aecbbaf4.slice/crio-b610a055d227f1fd5d12181aa9a6d2bce478c94bc3f911ba2d4b31d1dacb0e7f WatchSource:0}: Error finding container b610a055d227f1fd5d12181aa9a6d2bce478c94bc3f911ba2d4b31d1dacb0e7f: Status 404 returned error can't find the container with id b610a055d227f1fd5d12181aa9a6d2bce478c94bc3f911ba2d4b31d1dacb0e7f Sep 17 20:04:42.074078 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:42.074041 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" event={"ID":"e47cd037-d3ba-4a6d-8551-2142aecbbaf4","Type":"ContainerStarted","Data":"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae"} Sep 17 20:04:42.074508 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:42.074093 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" event={"ID":"e47cd037-d3ba-4a6d-8551-2142aecbbaf4","Type":"ContainerStarted","Data":"b610a055d227f1fd5d12181aa9a6d2bce478c94bc3f911ba2d4b31d1dacb0e7f"} Sep 17 20:04:42.074508 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:42.074139 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:04:42.091315 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:42.091253 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podStartSLOduration=2.091237247 podStartE2EDuration="2.091237247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 20:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 20:04:42.090177844 +0000 UTC m=+3491.151029473" watchObservedRunningTime="2026-09-17 20:04:42.091237247 +0000 UTC m=+3491.152088874" Sep 17 20:04:45.094765 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:45.094671 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:04:45.194631 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:04:45.194592 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:04.824668 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:04.824631 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:06.363812 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:06.363767 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:06.436921 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:06.436887 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:13.079615 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:13.079584 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:05:22.842725 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:22.842684 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:22.943767 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:22.943731 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:41.874841 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:41.874805 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:05:41.904883 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:41.904852 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:42.004599 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:42.004569 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:42.877120 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:42.877079 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:43.079770 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:43.079731 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:05:53.079696 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:53.079658 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:05:56.044771 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:56.044729 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:56.146115 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:56.146080 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:56.894282 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:56.894242 2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" containerID="cri-o://91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae" gracePeriod=45 Sep 17 20:05:58.895633 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:58.895597 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:05:59.128818 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:05:59.128788 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:02.873634 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:02.873584 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:03.085839 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:03.085794 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:06:03.086018 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:03.085952 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:06:03.219854 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:03.219764 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:08.682120 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:08.682083 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:08.895499 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:08.895466 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:13.080543 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:13.080501 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:06:23.079485 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:23.079399 2588 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 20:06:27.147219 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.147189 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:06:27.335584 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.335550 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs\") pod \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " Sep 17 20:06:27.335763 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.335612 2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j7x4\" (UniqueName: \"kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4\") pod \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\" (UID: \"e47cd037-d3ba-4a6d-8551-2142aecbbaf4\") " Sep 17 20:06:27.337757 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.337726 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e47cd037-d3ba-4a6d-8551-2142aecbbaf4" (UID: "e47cd037-d3ba-4a6d-8551-2142aecbbaf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 20:06:27.337865 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.337809 2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4" (OuterVolumeSpecName: "kube-api-access-7j7x4") pod "e47cd037-d3ba-4a6d-8551-2142aecbbaf4" (UID: "e47cd037-d3ba-4a6d-8551-2142aecbbaf4"). InnerVolumeSpecName "kube-api-access-7j7x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 20:06:27.436422 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.436384 2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-tls-certs\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 20:06:27.436422 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.436415 2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j7x4\" (UniqueName: \"kubernetes.io/projected/e47cd037-d3ba-4a6d-8551-2142aecbbaf4-kube-api-access-7j7x4\") on node \"ip-10-0-139-216.ec2.internal\" DevicePath \"\"" Sep 17 20:06:27.493936 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.493906 2588 generic.go:356] "Generic (PLEG): container finished" podID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerID="91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae" exitCode=0 Sep 17 20:06:27.494084 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.493949 2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" Sep 17 20:06:27.494084 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.493989 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" event={"ID":"e47cd037-d3ba-4a6d-8551-2142aecbbaf4","Type":"ContainerDied","Data":"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae"} Sep 17 20:06:27.494084 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.494038 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb" event={"ID":"e47cd037-d3ba-4a6d-8551-2142aecbbaf4","Type":"ContainerDied","Data":"b610a055d227f1fd5d12181aa9a6d2bce478c94bc3f911ba2d4b31d1dacb0e7f"} Sep 17 20:06:27.494084 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.494063 2588 scope.go:117] "RemoveContainer" containerID="91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae" Sep 17 20:06:27.504768 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.504744 2588 scope.go:117] "RemoveContainer" containerID="91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae" Sep 17 20:06:27.505231 ip-10-0-139-216 kubenswrapper[2588]: E0917 20:06:27.505212 2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae\": container with ID starting with 91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae not found: ID does not exist" containerID="91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae" Sep 17 20:06:27.505312 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.505240 2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae"} err="failed to get container status \"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae\": rpc error: code = NotFound desc = could not find container \"91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae\": container with ID starting with 91e5300cc75da5f321931b47304ea5ebac73461647257eb7cc62a7d7c81139ae not found: ID does not exist" Sep 17 20:06:27.515329 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.515301 2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:06:27.521551 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:27.521525 2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-router-scheduler-74c7697f55-brjcb"] Sep 17 20:06:29.123239 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:29.123206 2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" path="/var/lib/kubelet/pods/e47cd037-d3ba-4a6d-8551-2142aecbbaf4/volumes" Sep 17 20:06:32.027970 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:32.027931 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:32.139742 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:32.139707 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:32.808017 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:32.807980 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:32.907740 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:32.907707 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:38.398575 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:38.398541 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:39.392248 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:39.392211 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:39.610676 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:39.610635 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:44.298959 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:44.298920 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:44.361328 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:44.361295 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:47.110870 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:47.110835 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:49.998108 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:49.998073 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:06:50.068540 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:06:50.068505 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:13.746877 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:13.746837 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:13.847663 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:13.847617 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:22.481881 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:22.481846 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:22.572680 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:22.572642 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:28.769436 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:28.769397 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:34.480829 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:34.480791 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:34.545513 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:34.545484 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:48.497690 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:48.497602 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:07:48.744289 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:07:48.744249 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:03.086111 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:03.086077 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:03.880011 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:03.879975 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:10.000289 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:10.000257 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:16.003971 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:16.003940 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:16.080855 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:16.080820 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:22.336224 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:22.336189 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:22.403992 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:22.403960 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:08:47.182784 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:08:47.182741 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:11.644491 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:11.644457 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:15.773567 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:15.773486 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:15.857273 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:15.857242 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:17.879838 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:17.879805 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:23.782799 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:23.782759 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:23.883318 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:23.883282 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:39.410828 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:39.410788 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gx8jx_d7692cbb-fa3d-465e-9b7b-b1b6a340068a/discovery/0.log" Sep 17 20:09:39.428046 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:39.428014 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/0.log" Sep 17 20:09:39.434493 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:39.434466 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/1.log" Sep 17 20:09:40.271661 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:40.271627 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gx8jx_d7692cbb-fa3d-465e-9b7b-b1b6a340068a/discovery/0.log" Sep 17 20:09:40.301649 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:40.301617 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/0.log" Sep 17 20:09:40.307671 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:40.307641 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/1.log" Sep 17 20:09:41.392205 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:41.392170 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6fc8f864f4-nhvsq_e3405338-a760-4ce0-abe5-5e18f75c3950/manager/0.log" Sep 17 20:09:45.091767 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:45.091731 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:46.235497 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:46.235456 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:48.356766 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:48.356736 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdzrj_aae7adca-d307-4fd3-9a3c-8fa1bfe1951c/global-pull-secret-syncer/0.log" Sep 17 20:09:48.469205 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:48.469168 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" Sep 17 20:09:48.630786 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:48.630695 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-216.ec2.internal_96b467e339b8d6495a764e5b20a26147/haproxy/0.log" Sep 17 20:09:51.161724 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:51.161687 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:51.222091 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:51.222058 2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2txw9_894742b2-7ee1-4566-a173-385f22ebd8ed/konnectivity-agent/0.log" limit=1024 Sep 17 20:09:53.593931 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:53.593895 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6fc8f864f4-nhvsq_e3405338-a760-4ce0-abe5-5e18f75c3950/manager/0.log" Sep 17 20:09:55.423337 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.423315 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75d9b6bddd-kpcmr_c576e5c0-de80-490a-80a6-a78b297486a4/metrics-server/0.log" Sep 17 20:09:55.451671 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.451644 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-b9vls_2bc8c473-3e1a-4bff-9902-9fa6eba79a7f/monitoring-plugin/0.log" Sep 17 20:09:55.663769 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.663739 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fwr_69af9d96-75ec-46d8-8e03-3cb7060068a2/node-exporter/0.log" Sep 17 20:09:55.685119 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.685030 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fwr_69af9d96-75ec-46d8-8e03-3cb7060068a2/kube-rbac-proxy/0.log" Sep 17 20:09:55.714445 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.714421 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4fwr_69af9d96-75ec-46d8-8e03-3cb7060068a2/init-textfile/0.log" Sep 17 20:09:55.747261 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.747238 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9scjn_4cb20a04-e566-4472-a047-a5db0788e2be/kube-rbac-proxy-main/0.log" Sep 17 20:09:55.773302 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.773271 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9scjn_4cb20a04-e566-4472-a047-a5db0788e2be/kube-rbac-proxy-self/0.log" Sep 17 20:09:55.799738 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.799700 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9scjn_4cb20a04-e566-4472-a047-a5db0788e2be/openshift-state-metrics/0.log" Sep 17 20:09:55.849061 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.849033 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/prometheus/0.log" Sep 17 20:09:55.867756 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.867723 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/config-reloader/0.log" Sep 17 20:09:55.893688 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.893658 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/thanos-sidecar/0.log" Sep 17 20:09:55.918751 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.918724 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/kube-rbac-proxy-web/0.log" Sep 17 20:09:55.944554 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.944476 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/kube-rbac-proxy/0.log" Sep 17 20:09:55.969025 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.968992 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/kube-rbac-proxy-thanos/0.log" Sep 17 20:09:55.992291 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:55.992266 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3878c1d0-5868-46ba-889c-9822278aff15/init-config-reloader/0.log" Sep 17 20:09:56.029433 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:56.029408 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4s6mt_89afa468-f592-4cd0-914e-3d8e649fe132/prometheus-operator/0.log" Sep 17 20:09:56.049434 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:56.049408 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4s6mt_89afa468-f592-4cd0-914e-3d8e649fe132/kube-rbac-proxy/0.log" Sep 17 20:09:58.551492 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.551459 2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6"] Sep 17 20:09:58.551873 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.551746 2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" Sep 17 20:09:58.551873 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.551756 2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" Sep 17 20:09:58.551873 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.551821 2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="e47cd037-d3ba-4a6d-8551-2142aecbbaf4" containerName="main" Sep 17 20:09:58.554892 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.554870 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.557676 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.557649 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhr8t\"/\"kube-root-ca.crt\"" Sep 17 20:09:58.557780 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.557715 2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rhr8t\"/\"default-dockercfg-cks9b\"" Sep 17 20:09:58.557780 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.557716 2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhr8t\"/\"openshift-service-ca.crt\"" Sep 17 20:09:58.564917 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.564891 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6"] Sep 17 20:09:58.644803 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.644769 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-cf87n_84af57d9-8d9a-4776-abaa-138e227b5f75/download-server/0.log" Sep 17 20:09:58.686034 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.686000 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-proc\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.686034 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.686034 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gq55\" (UniqueName: \"kubernetes.io/projected/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-kube-api-access-2gq55\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.686254 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.686076 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-sys\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.686254 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.686103 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-lib-modules\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.686254 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.686151 2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-podres\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786746 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786716 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-proc\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786746 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786749 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gq55\" (UniqueName: \"kubernetes.io/projected/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-kube-api-access-2gq55\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786813 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-sys\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786840 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-lib-modules\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786849 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-proc\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786906 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-sys\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786920 2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-podres\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.786997 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.786992 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-lib-modules\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.787218 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.787067 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-podres\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.794707 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.794675 2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gq55\" (UniqueName: \"kubernetes.io/projected/611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f-kube-api-access-2gq55\") pod \"perf-node-gather-daemonset-kxxn6\" (UID: \"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f\") " pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:58.865154 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:58.865065 2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:59.135764 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:59.135563 2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6"] Sep 17 20:09:59.138413 ip-10-0-139-216 kubenswrapper[2588]: W0917 20:09:59.138376 2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod611b13ca_c0ee_4b30_b7a1_faa3e0d0fe1f.slice/crio-90f66903c5ab2c7e4480516962e665bcf7c87c6c0c28aa9ed29d93a3f1ca3ae3 WatchSource:0}: Error finding container 90f66903c5ab2c7e4480516962e665bcf7c87c6c0c28aa9ed29d93a3f1ca3ae3: Status 404 returned error can't find the container with id 90f66903c5ab2c7e4480516962e665bcf7c87c6c0c28aa9ed29d93a3f1ca3ae3 Sep 17 20:09:59.326907 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:59.326872 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" event={"ID":"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f","Type":"ContainerStarted","Data":"00e0347e41d4132d86b1de75aae64de204143d9dc8fb3bf34d0ce29a1834c690"} Sep 17 20:09:59.327106 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:59.326930 2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" event={"ID":"611b13ca-c0ee-4b30-b7a1-faa3e0d0fe1f","Type":"ContainerStarted","Data":"90f66903c5ab2c7e4480516962e665bcf7c87c6c0c28aa9ed29d93a3f1ca3ae3"} Sep 17 20:09:59.327106 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:59.326975 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:09:59.342182 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:09:59.342095 2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" podStartSLOduration=1.3420739529999999 podStartE2EDuration="1.342073953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 20:09:59.341855887 +0000 UTC m=+3808.402707541" watchObservedRunningTime="2026-09-17 20:09:59.342073953 +0000 UTC m=+3808.402925581" Sep 17 20:10:00.347734 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:00.347704 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xwldz_b338c7d1-81e0-4c88-8611-e776bbe40fb6/dns/0.log" Sep 17 20:10:00.370402 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:00.370376 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xwldz_b338c7d1-81e0-4c88-8611-e776bbe40fb6/kube-rbac-proxy/0.log" Sep 17 20:10:00.452886 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:00.452862 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4njp_216976d1-3300-45da-9dd3-e019e573c5ee/dns-node-resolver/0.log" Sep 17 20:10:01.102303 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:01.102274 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wn8z5_138625ed-563d-4553-9ef4-67e541c29dbd/node-ca/0.log" Sep 17 20:10:02.166703 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:02.166674 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gx8jx_d7692cbb-fa3d-465e-9b7b-b1b6a340068a/discovery/0.log" Sep 17 20:10:02.197244 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:02.197209 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/0.log" Sep 17 20:10:02.203475 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:02.203445 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/1.log" Sep 17 20:10:02.797490 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:02.797458 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-76rz2_c7ce6f2e-667e-48c4-be32-514b826ecd1a/serve-healthcheck-canary/0.log" Sep 17 20:10:03.323645 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:03.323619 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h5w6_601abfe7-c77a-4d28-8447-907985bb4cc6/kube-rbac-proxy/0.log" Sep 17 20:10:03.348151 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:03.348124 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h5w6_601abfe7-c77a-4d28-8447-907985bb4cc6/exporter/0.log" Sep 17 20:10:03.372222 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:03.372195 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5h5w6_601abfe7-c77a-4d28-8447-907985bb4cc6/extractor/0.log" Sep 17 20:10:05.340574 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:05.340546 2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rhr8t/perf-node-gather-daemonset-kxxn6" Sep 17 20:10:06.470761 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:06.470732 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56c5b7c858-52zwh_6621082d-6d99-4d6b-91fe-cf26fd3adf2a/manager/0.log" Sep 17 20:10:07.870325 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:07.870281 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gx8jx_d7692cbb-fa3d-465e-9b7b-b1b6a340068a/discovery/0.log" Sep 17 20:10:07.896620 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:07.896567 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/0.log" Sep 17 20:10:07.902743 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:07.902717 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/1.log" Sep 17 20:10:09.179456 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:09.179420 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-gx8jx_d7692cbb-fa3d-465e-9b7b-b1b6a340068a/discovery/0.log" Sep 17 20:10:09.199795 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:09.199763 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/0.log" Sep 17 20:10:09.206403 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:09.206374 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-58c5cd85c9-tv4mb_b3bd6da9-f6b3-44eb-90a3-42e42196e0c2/istio-proxy/1.log" Sep 17 20:10:14.831734 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.831708 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/kube-multus-additional-cni-plugins/0.log" Sep 17 20:10:14.854105 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.854059 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/egress-router-binary-copy/0.log" Sep 17 20:10:14.877275 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.877243 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/cni-plugins/0.log" Sep 17 20:10:14.899786 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.899703 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/bond-cni-plugin/0.log" Sep 17 20:10:14.923477 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.923443 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/routeoverride-cni/0.log" Sep 17 20:10:14.946500 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.946473 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/whereabouts-cni-bincopy/0.log" Sep 17 20:10:14.971915 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:14.971885 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lmdzn_2226e368-5e76-43fc-82ee-e837bab7359d/whereabouts-cni/0.log" Sep 17 20:10:15.452402 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:15.452344 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lqm56_dd9536b0-b583-49a9-b19d-1c36e2134a37/kube-multus/0.log" Sep 17 20:10:15.561034 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:15.561001 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82nmg_e4a2299a-b3d7-43bc-a83d-e63be8e7584f/network-metrics-daemon/0.log" Sep 17 20:10:15.583738 ip-10-0-139-216 kubenswrapper[2588]: I0917 20:10:15.583706 2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82nmg_e4a2299a-b3d7-43bc-a83d-e63be8e7584f/kube-rbac-proxy/0.log"