Sep 17 17:32:27.597969 ip-10-0-134-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 17:32:27.597978 ip-10-0-134-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 17:32:27.597984 ip-10-0-134-158 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 17:32:27.598123 ip-10-0-134-158 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 17:32:37.846908 ip-10-0-134-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 17:32:37.846926 ip-10-0-134-158 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot acda6915371f4b13abe63c1b93be87ca --
Sep 17 17:34:29.155757 ip-10-0-134-158 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 17:34:32.572354 ip-10-0-134-158 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:32.572354 ip-10-0-134-158 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 17:34:32.572354 ip-10-0-134-158 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:32.572354 ip-10-0-134-158 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 17:34:32.572354 ip-10-0-134-158 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:32.573034 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.572756    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 17:34:32.576303 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576287    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.576303 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576303    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576306    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576309    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576312    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576314    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576319    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576323    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576326    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576329    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576332    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576335    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576338    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576345    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576349    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576352    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576354    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576357    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576360    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576364    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.576371 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576367    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576369    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576372    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576374    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576377    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576380    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576382    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576386    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576388    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576390    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576393    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576396    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576399    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576401    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576404    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576406    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576408    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576411    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576413    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576423    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.576864 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576427    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576429    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576433    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576436    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576439    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576442    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576445    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576448    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576451    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576453    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576456    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576458    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576460    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576463    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576467    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576470    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576486    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576488    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576491    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576493    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.577326 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576496    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576499    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576501    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576504    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576506    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576508    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576511    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576513    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576516    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576518    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576548    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576551    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576554    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576558    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576561    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576565    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576568    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576570    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576573    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576575    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.577810 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576578    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576580    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576583    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576585    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576587    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576590    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576593    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576596    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576598    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576600    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576603    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576605    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576608    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576610    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576613    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576615    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576618    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576620    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.576622    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577926    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.578262 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577934    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577937    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577940    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577944    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577947    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577950    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577953    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577955    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577958    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577961    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577965    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577969    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577972    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577974    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577977    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577980    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577982    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577985    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577988    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.578744 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577991    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577994    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577996    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.577999    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578001    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578004    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578007    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578009    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578012    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578014    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578016    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578019    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578021    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578024    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578026    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578029    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578031    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578033    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578036    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578038    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.579252 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578041    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578043    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578050    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578053    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578055    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578057    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578060    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578062    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578066    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578068    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578070    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578074    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578077    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578079    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578081    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578084    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578086    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578089    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578091    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578094    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.579750 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578097    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578099    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578101    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578104    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578106    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578109    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578111    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578113    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578116    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578120    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578124    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578127    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578129    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578132    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578134    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578137    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578140    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578142    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578145    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578147    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.580221 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578150    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578152    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578154    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578159    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578162    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578164    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578167    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578169    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578172    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578174    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578177    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578179    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578182    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578184    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578187    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578190    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578193    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578196    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578198    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.580715 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578568    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578573    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578576    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578578    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578581    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578584    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578587    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578590    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578592    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578595    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578598    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578600    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578602    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578605    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578607    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578609    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578613    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578616    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578618    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578621    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.581163 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578623    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578626    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578628    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578630    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578633    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578635    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578637    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578640    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578642    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578645    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578647    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578649    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578651    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578654    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578656    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578658    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578661    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578663    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578665    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578668    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.581650 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578670    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578674    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578676    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578678    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578681    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578684    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578686    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578688    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578691    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578694    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578696    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578700    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578704    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578707    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578709    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578712    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578714    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578717    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578720    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.582115 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578723    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578725    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578728    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578730    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578732    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578735    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578737    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578739    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578742    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578744    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578747    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578749    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578752    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578754    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578757    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578759    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578762    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578764    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578767    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.582586 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578770    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578772    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578776    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578778    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578781    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578783    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578786    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578788    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578791    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578793    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578795    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578798    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578800    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578803    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578805    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578808    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578812    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578814    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578818    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578821    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.583036 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.578824    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578895    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578927    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578932    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578936    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578940    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578942    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578946    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578950    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578959    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578962    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578965    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578968    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578972    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578974    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578977    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578980    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578982    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578985    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578989    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578992    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578995    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.578998    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579001    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 17:34:32.583583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579004    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579007    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579010    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579012    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579015    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579018    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579020    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579023    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579026    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579029    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579032    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579035    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579037    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579040    2581 flags.go:64] FLAG: --enable-server="true"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579042    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579046    2581 flags.go:64] FLAG: --event-burst="100"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579049    2581 flags.go:64] FLAG: --event-qps="50"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579051    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579054    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579057    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579061    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579065    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579069    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579072    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579075    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 17:34:32.584152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579078    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579081    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579083    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579086    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579088    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579091    2581 flags.go:64] FLAG: --feature-gates=""
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579094    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579097    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579100    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579103    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579106    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579109    2581 flags.go:64] FLAG: --help="false"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579111    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579114    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579117    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579120    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579123    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579126    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579128    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579131    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579134    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579136    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579139    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579142    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 17:34:32.584795 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579144    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579147    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579155    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579158    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579162    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579166    2581 flags.go:64] FLAG: --lock-file=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579169    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579171    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579174    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579179    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579182    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579184    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579187    2581 flags.go:64] FLAG: --logging-format="text"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579190    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579193    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579195    2581 flags.go:64] FLAG: --manifest-url=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579198    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579202    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579205    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579208    2581 flags.go:64] FLAG: --max-pods="110"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579211    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579214    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579216    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579219    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579222    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 17:34:32.585368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579225    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579228    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579235    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579237    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579240    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579243    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579245    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579250    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579253    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579256    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579267    2581 flags.go:64] FLAG: --port="10250"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579270    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579276    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8714b72f555c513"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579279    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579282    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579285    2581 flags.go:64] FLAG: --register-node="true"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579287    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579290    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579293    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579296    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579298    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579302    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579305    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579307    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579310    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 17:34:32.586077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579312    2581 flags.go:64] FLAG: --runonce="false"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579315    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579318    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579321    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579323    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579326    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579328    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579331    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579334    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579336    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579339    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579341    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579344    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579346    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579349    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579352    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579357    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579359    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579367    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579377    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579380    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579382    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579385    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579388    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579390    2581 flags.go:64] FLAG: --v="2"
Sep 17 17:34:32.586690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579394    2581 flags.go:64] FLAG: --version="false"
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579398    2581 flags.go:64] FLAG: --vmodule=""
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579401    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.579404    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579523    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579527    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579531    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579533    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579536    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579538    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579541    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579543    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579546    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579549    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579551    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579553    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579556    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579558    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579561    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579563    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579566    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.587283 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579568    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579570    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579573    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579575    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579577    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579583    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579585    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579588    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579590    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579592    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579595    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579597    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579600    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579602    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579605    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579607    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579609    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579612    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579614    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579617    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.587776 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579619    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579622    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579624    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579627    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579630    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579632    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579634    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579637    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579639    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579641    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579644    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579646    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579649    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579651    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579653    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579656    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579658    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579663    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579665    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579668    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.588242 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579670    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579673    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579675    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579678    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579680    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579683    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579686    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579690    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579692    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579695    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579698    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579700    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579703    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579705    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579708    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579710    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579713    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579715    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579719    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.588753 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579721    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579724    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579726    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579729    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579731    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579735    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579738    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579742    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579745    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579748    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579754    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579757    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579760    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579763    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579765    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579768    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579770    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579773    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579775    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.589194 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579777    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579780    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579782    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.579785    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.580246    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.587603    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.587617    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.587636    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.587641    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587707    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587712    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587716    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587719    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587722    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587725    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.589656 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587728    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587731    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587733    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587736    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587739    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587743    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587747    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587751    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587754    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587757    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587767    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587770    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587773    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587776    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587779    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587782    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587785    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587788    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587791    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.590010 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587794    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587796    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587799    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587803    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587807    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587810    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587813    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587816    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587819    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587821    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587824    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587826    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587829    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587831    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587834    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587836    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587839    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587845    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587847    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587849    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.590461 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587852    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587854    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587857    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587859    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587867    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587869    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587872    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587874    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587877    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587879    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587881    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587884    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587886    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587889    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587891    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587894    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587897    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587899    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587902    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587904    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.590995 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587907    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587910    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587912    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587914    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587917    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587919    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587921    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587924    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587927    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587929    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587931    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587934    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587936    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587939    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587941    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587943    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587946    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587956    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587959    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587962    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.591499 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587964    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587966    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587969    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587971    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587973    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587976    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587978    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587981    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587984    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587986    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587989    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587991    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587993    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.587996    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.588000    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:32.591981 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588137    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588142    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588145    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588147    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588150    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588152    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588155    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588158    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588162    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588165    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588168    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588170    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588172    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588175    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588177    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588185    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588188    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588190    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588193    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588196    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:32.592335 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588199    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588202    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588205    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588208    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588210    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588213    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588215    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588218    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588220    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588223    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588225    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588227    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588230    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588232    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588235    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588237    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588240    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588242    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588244    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588247    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:32.592808 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588249    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588252    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588255    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588257    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588260    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588262    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588265    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588268    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588276    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588280    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588282    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588285    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588287    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588289    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588292    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588294    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588297    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588300    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588302    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588304    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:32.593268 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588307    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588309    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588311    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588314    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588316    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588319    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588321    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588323    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588326    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588328    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588336    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588338    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588341    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588343    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588345    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588347    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588350    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588352    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588354    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:32.593769 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588357    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588359    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588368    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588370    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588373    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588375    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588377    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588380    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588382    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588385    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588392    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588395    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588398    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588400    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588402    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588405    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588407    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588410    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588412    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:32.594542 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:32.588414    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.588427    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.588552    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.590666    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.591527    2581 server.go:1019] "Starting client certificate rotation"
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.591626    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:34:32.595175 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.591659    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:34:32.595537 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.595521    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:34:32.597379 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.597354    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:34:32.600978 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.600962    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 17 17:34:32.602319 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.602306    2581 log.go:25] "Validated CRI v1 image API"
Sep 17 17:34:32.603181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.603168    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 17:34:32.605600 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.605575    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9b9b15c5-94af-4645-a4b9-a3a61216bf36:/dev/nvme0n1p4 ce8156b6-7ea3-4761-bc0c-e6cfa99a0556:/dev/nvme0n1p3]
Sep 17 17:34:32.605660 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.605600    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 17:34:32.609912 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.609812    2581 manager.go:216] Machine: {Timestamp:2026-09-17 17:34:32.609350279 +0000 UTC m=+1.916236282 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201877 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a16619999ab803ac3808cc938593d SystemUUID:ec2a1661-9999-ab80-3ac3-808cc938593d BootID:acda6915-371f-4b13-abe6-3c1b93be87ca Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f7:22:d4:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f7:22:d4:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:4c:8a:3d:61:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 17:34:32.609912 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.609911    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 17:34:32.610012 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.609978    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 17:34:32.611462 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.611429    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 17:34:32.611604 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.611465    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 17:34:32.612522 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.612506    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 17:34:32.612522 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.612524    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 17:34:32.612631 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.612534    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:34:32.612631 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.612545    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:34:32.612631 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.612616    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 17:34:32.615749 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615737    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:34:32.615877 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615868    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 17:34:32.615910 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615901    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 17:34:32.615938 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615912    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 17:34:32.615938 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615925    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 17:34:32.615938 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615935    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 17 17:34:32.616026 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.615943    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 17:34:32.616223 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.616213    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:34:32.616257 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.616230    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:34:32.619930 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.619909    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 17:34:32.621901 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.621884    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 17:34:32.621991 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.621921    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 17:34:32.623018 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623004    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623024    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623034    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623050    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623061    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623069    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 17:34:32.623085 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623087    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623095    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623104    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623112    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623124    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623132    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623205    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 17:34:32.623309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.623215    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 17:34:32.626765 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.626750    2581 server.go:1268] "Started kubelet"
Sep 17 17:34:32.626886 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.626828    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 17:34:32.626931 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.626911    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 17:34:32.627504 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.627440    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 17:34:32.627568 ip-10-0-134-158 systemd[1]: Started Kubernetes Kubelet.
Sep 17 17:34:32.628011 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.627900    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 17:34:32.628686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.628585    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:34:32.628743 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.628702    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 17:34:32.629990 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.629964    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 17:34:32.629990 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.629964    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 17:34:32.630117 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.630091    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 17:34:32.631229 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.631207    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 17:34:32.633366 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.633349    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 17:34:32.633458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.633368    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 17:34:32.633458 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.633441    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:32.634182 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634158    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 17:34:32.634182 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634180    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 17:34:32.634300 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634183    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 17:34:32.634338 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634311    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 17:34:32.634338 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634319    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 17:34:32.634506 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634471    2581 factory.go:55] Registering systemd factory
Sep 17 17:34:32.634549 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634511    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 17 17:34:32.634731 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634713    2581 factory.go:153] Registering CRI-O factory
Sep 17 17:34:32.634731 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634732    2581 factory.go:223] Registration of the crio container factory successfully
Sep 17 17:34:32.634865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634798    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 17:34:32.634865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634812    2581 factory.go:103] Registering Raw factory
Sep 17 17:34:32.634865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.634822    2581 manager.go:1196] Started watching for new ooms in manager
Sep 17 17:34:32.635332 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.635316    2581 manager.go:349] Starting recovery of all containers
Sep 17 17:34:32.636738 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.636719    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 17:34:32.636839 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.636798    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 17:34:32.662801 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.662746    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 17:34:32.666991 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.666975    2581 manager.go:354] Recovery completed
Sep 17 17:34:32.670935 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.670911    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.672600 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.672583    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.672698 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.672616    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.672698 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.672630    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.673207 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673190    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 17:34:32.673207 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673206    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 17:34:32.673316 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673209    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.673316 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673219    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:34:32.673885 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.673084    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cbf579862  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.626722914 +0000 UTC m=+1.933608918,LastTimestamp:2026-09-17 17:34:32.626722914 +0000 UTC m=+1.933608918,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.673988 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673898    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.673988 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673929    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.673988 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.673944    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.674537 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.674524    2581 policy_none.go:49] "None policy: Start"
Sep 17 17:34:32.674579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.674541    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 17:34:32.674579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.674551    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 17:34:32.675513 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.675503    2581 policy_none.go:47] "Start"
Sep 17 17:34:32.683827 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.683768    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc213a144  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.672600388 +0000 UTC m=+1.979486397,LastTimestamp:2026-09-17 17:34:32.672600388 +0000 UTC m=+1.979486397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.685752 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.685692    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc213f8b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.672622773 +0000 UTC m=+1.979508777,LastTimestamp:2026-09-17 17:34:32.672622773 +0000 UTC m=+1.979508777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.697220 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.697148    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc2142c2e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.67263595 +0000 UTC m=+1.979521955,LastTimestamp:2026-09-17 17:34:32.67263595 +0000 UTC m=+1.979521955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.708186 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708079    2581 manager.go:337] "Starting Device Plugin manager"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.708210    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708222    2581 server.go:87] "Starting device plugin registration server"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708447    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708470    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708585    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.708545    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-158.ec2.internal.18d62c2cc213a144\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc213a144  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.672600388 +0000 UTC m=+1.979486397,LastTimestamp:2026-09-17 17:34:32.673912407 +0000 UTC m=+1.980798417,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708663    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.708674    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.709025    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.709091    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:32.723091 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.720887    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-158.ec2.internal.18d62c2cc213f8b5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc213f8b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.672622773 +0000 UTC m=+1.979508777,LastTimestamp:2026-09-17 17:34:32.673936613 +0000 UTC m=+1.980822618,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.734544 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.734469    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-158.ec2.internal.18d62c2cc2142c2e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc2142c2e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-158.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.67263595 +0000 UTC m=+1.979521955,LastTimestamp:2026-09-17 17:34:32.673950654 +0000 UTC m=+1.980836659,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.750007 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.749956    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-158.ec2.internal.18d62c2cc4a76528  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-158.ec2.internal,UID:ip-10-0-134-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-158.ec2.internal,},FirstTimestamp:2026-09-17 17:34:32.71583876 +0000 UTC m=+2.022724755,LastTimestamp:2026-09-17 17:34:32.71583876 +0000 UTC m=+2.022724755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-158.ec2.internal,}"
Sep 17 17:34:32.775735 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.775719    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnz2c"
Sep 17 17:34:32.785940 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.785922    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnz2c"
Sep 17 17:34:32.801769 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.801751    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 17:34:32.801864 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.801806    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 17:34:32.801864 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.801830    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 17:34:32.801940 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.801872    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 17:34:32.809527 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.809509    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.810150 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.810136    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.810213 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.810162    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.810213 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.810171    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.810213 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.810188    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.810631 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.810619    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:32.846461 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.846424    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.846461 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.846443    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-158.ec2.internal\": node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:32.862923 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.862900    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:32.902927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.902879    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"]
Sep 17 17:34:32.902991 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.902961    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.903663 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.903648    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.903727 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.903679    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.903727 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.903688    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.904758 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.904746    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.904869 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.904854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.904919 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.904881    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.905360 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905334    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.905360 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905342    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.905360 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905360    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.905582 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905365    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.905582 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905375    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.905582 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.905379    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.906434 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.906420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.906488 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.906446    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:32.907084 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.907068    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:32.907160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.907094    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:32.907160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.907103    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:32.922027 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.922012    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-158.ec2.internal\" not found" node="ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.925957 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.925935    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-158.ec2.internal\" not found" node="ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.935563 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.935548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.935617 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.935575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.935617 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:32.935590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3564b9943b12f3f32f2d5c68ae2dba3e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-158.ec2.internal\" (UID: \"3564b9943b12f3f32f2d5c68ae2dba3e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:32.963160 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:32.963146    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.035896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.035979 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.035979 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3564b9943b12f3f32f2d5c68ae2dba3e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-158.ec2.internal\" (UID: \"3564b9943b12f3f32f2d5c68ae2dba3e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.035979 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.035979 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3564b9943b12f3f32f2d5c68ae2dba3e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-158.ec2.internal\" (UID: \"3564b9943b12f3f32f2d5c68ae2dba3e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.036101 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.035977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a92dd837ac005c2b7d676a0a2ed0d89f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal\" (UID: \"a92dd837ac005c2b7d676a0a2ed0d89f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.064209 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.064187    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.165186 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.165140    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.225331 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.225304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.230620 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.230604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:33.265683 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.265658    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.366209 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.366183    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.466702 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.466642    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.567334 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.567304    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.591470 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.591451    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 17:34:33.591875 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.591597    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 17:34:33.668098 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.668065    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.679322 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.679302    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:33.769110 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.769042    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.789119 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.789082    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:29:32 +0000 UTC" deadline="2028-03-25 08:38:57.192058749 +0000 UTC"
Sep 17 17:34:33.789119 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.789109    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13311h4m23.402954151s"
Sep 17 17:34:33.790092 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.790076    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:33.830053 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:33.830025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92dd837ac005c2b7d676a0a2ed0d89f.slice/crio-6fb17f7b7236ebeccb13b884de06f185695862665c82659a01a310c66ebfd726 WatchSource:0}: Error finding container 6fb17f7b7236ebeccb13b884de06f185695862665c82659a01a310c66ebfd726: Status 404 returned error can't find the container with id 6fb17f7b7236ebeccb13b884de06f185695862665c82659a01a310c66ebfd726
Sep 17 17:34:33.830551 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:33.830531    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3564b9943b12f3f32f2d5c68ae2dba3e.slice/crio-49e77a221d8e11cd412c818e6d9c7ed9390283c7aabad6bebe3bc7e3c20a2d74 WatchSource:0}: Error finding container 49e77a221d8e11cd412c818e6d9c7ed9390283c7aabad6bebe3bc7e3c20a2d74: Status 404 returned error can't find the container with id 49e77a221d8e11cd412c818e6d9c7ed9390283c7aabad6bebe3bc7e3c20a2d74
Sep 17 17:34:33.834804 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.834790    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:34:33.843447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.843433    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:33.844870 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.844849    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:33.844944 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.844880    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:33.844944 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:33.844893    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:33.870058 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.870040    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:33.970539 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:33.970512    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:34.071077 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.071018    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:34.171828 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.171792    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-158.ec2.internal\" not found"
Sep 17 17:34:34.198552 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.198532    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:34.233713 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.233687    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:34.248109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.248086    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:34:34.248820 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.248794    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal"
Sep 17 17:34:34.261314 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.261295    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:34:34.617296 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.617269    2581 apiserver.go:52] "Watching apiserver"
Sep 17 17:34:34.631336 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.631271    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 17:34:34.632250 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.632226    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-849lz","openshift-cluster-node-tuning-operator/tuned-n5lkw","openshift-image-registry/node-ca-6smjf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal","openshift-multus/multus-ppzvm","openshift-network-operator/iptables-alerter-xhsj8","openshift-ovn-kubernetes/ovnkube-node-q9bgc","kube-system/global-pull-secret-syncer-lh6dh","kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv","openshift-dns/node-resolver-dqxrl","openshift-multus/multus-additional-cni-plugins-rq9mv","openshift-multus/network-metrics-daemon-d49h2","openshift-network-diagnostics/network-check-target-wt72c"]
Sep 17 17:34:34.633709 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.633678    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 17:34:34.633968 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.633945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.634962 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.634946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.635079 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.635012    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:34.636467 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.636445    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.636690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.636672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.636760 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.636726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 17:34:34.636914 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.636890    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gf4j8\""
Sep 17 17:34:34.637006 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.636897    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.638935 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.638913    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.639754 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.639734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:34.639853 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.639806    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:34.639926 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.639898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5cldl\""
Sep 17 17:34:34.639985 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.639966    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 17:34:34.640096 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.640081    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.640489 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.640453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.641803 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.641783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.642995 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.642971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.643394 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.643266    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.643534 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.643521    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.643767 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.643751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 17:34:34.644248 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644231    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gv8ch\""
Sep 17 17:34:34.644576 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644559    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 17:34:34.644770 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644755    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2zc68\""
Sep 17 17:34:34.644847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.644847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.644847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-sys-fs\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.644847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq99z\" (UniqueName: \"kubernetes.io/projected/7678c1cf-cd4e-499d-9e7c-99813338f96a-kube-api-access-zq99z\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.644847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-socket-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-registration-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644909    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtqh\" (UniqueName: \"kubernetes.io/projected/49f5f083-0838-433b-b94d-3d5d37b65797-kube-api-access-dwtqh\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.644964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-device-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.645109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.645089    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 17:34:34.645528 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.645136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 17:34:34.645528 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.645271    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.645799 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.645781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfwbm\""
Sep 17 17:34:34.646077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.646061    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 17:34:34.647543 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.647306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.647986 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.647968    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.648249 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.648204    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.648357 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.648258    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 17:34:34.648357 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.648328    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 17:34:34.649005 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.648977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.649374 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.649314    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 17:34:34.649719 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.649701    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:34:34.650206 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.650180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9zv5\""
Sep 17 17:34:34.651099 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.650180    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.651099 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.650593    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x75ps\""
Sep 17 17:34:34.651099 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.650675    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 17:34:34.651099 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.650768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.651557 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.651384    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.655692 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.655674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.655793 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.655769    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:34.657500 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.656765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 17:34:34.657500 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.657049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 17:34:34.657500 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.657152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-54bsf\""
Sep 17 17:34:34.657848 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.657829    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 17:34:34.658126 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.658106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xlgpr\""
Sep 17 17:34:34.658528 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.658423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 17:34:34.681238 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.681080    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4t8zd"
Sep 17 17:34:34.690281 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.690266    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4t8zd"
Sep 17 17:34:34.735580 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.735565    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 17:34:34.746045 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.746141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-run\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-tmp\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-kubelet\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c0e73f1-9be5-45ef-9f57-85494a346503-host-slash\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-binary-copy\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.746235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-socket-dir-parent\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-etc-kubernetes\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-netns\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-log-socket\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-netd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb146d57-9f25-468d-8676-ab37786ff2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq99z\" (UniqueName: \"kubernetes.io/projected/7678c1cf-cd4e-499d-9e7c-99813338f96a-kube-api-access-zq99z\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-netns\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-hostroot\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmdb\" (UniqueName: \"kubernetes.io/projected/8c0e73f1-9be5-45ef-9f57-85494a346503-kube-api-access-8fmdb\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-tmp-dir\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzmj\" (UniqueName: \"kubernetes.io/projected/a36a4e87-d8e8-4814-a87f-da58c1c478e9-kube-api-access-kbzmj\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-system-cni-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysconfig\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-var-lib-kubelet\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-tuned\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-cnibin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-socket-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5a49f-56e1-49ac-9b59-d621137a02fc-konnectivity-ca\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-daemon-config\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-hosts-file\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7a5a49f-56e1-49ac-9b59-d621137a02fc-agent-certs\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.746838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-socket-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9mq\" (UniqueName: \"kubernetes.io/projected/ae36ae40-d704-46ac-af5d-2d102b25cb51-kube-api-access-lt9mq\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-script-lib\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-registration-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-conf\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-cni-binary-copy\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjps\" (UniqueName: \"kubernetes.io/projected/e901ce13-a6bc-4bec-9ef9-80933789d83b-kube-api-access-kcjps\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-registration-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.746964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-etc-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-multus\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-kubernetes\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-kubelet-config\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-conf-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-multus-certs\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.747447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-slash\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-node-log\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-config\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4s8\" (UniqueName: \"kubernetes.io/projected/4e1d621b-1890-4f19-a63a-1ae86ce5a163-kube-api-access-pq4s8\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-systemd-units\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-var-lib-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-modprobe-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a36a4e87-d8e8-4814-a87f-da58c1c478e9-host\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-system-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.747410    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zr5j\" (UniqueName: \"kubernetes.io/projected/bb146d57-9f25-468d-8676-ab37786ff2b6-kube-api-access-5zr5j\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-host\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.747536    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:35.247516539 +0000 UTC m=+4.554402546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:34.748181 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-k8s-cni-cncf-io\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-cnibin\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtqh\" (UniqueName: \"kubernetes.io/projected/49f5f083-0838-433b-b94d-3d5d37b65797-kube-api-access-dwtqh\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-systemd\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c0e73f1-9be5-45ef-9f57-85494a346503-iptables-alerter-script\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-kubelet\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-bin\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-env-overrides\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a36a4e87-d8e8-4814-a87f-da58c1c478e9-serviceca\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-bin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-device-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-sys-fs\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-sys\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-lib-modules\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-device-dir\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.748697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7678c1cf-cd4e-499d-9e7c-99813338f96a-sys-fs\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-systemd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.747996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-dbus\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.748015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.748036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpghm\" (UniqueName: \"kubernetes.io/projected/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-kube-api-access-vpghm\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.748074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-ovn\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.749148 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.748110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.760239 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.760216    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 17:34:34.763722 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.763705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtqh\" (UniqueName: \"kubernetes.io/projected/49f5f083-0838-433b-b94d-3d5d37b65797-kube-api-access-dwtqh\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:34.763814 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.763732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq99z\" (UniqueName: \"kubernetes.io/projected/7678c1cf-cd4e-499d-9e7c-99813338f96a-kube-api-access-zq99z\") pod \"aws-ebs-csi-driver-node-7ncnv\" (UID: \"7678c1cf-cd4e-499d-9e7c-99813338f96a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.806493 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.806441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal" event={"ID":"a92dd837ac005c2b7d676a0a2ed0d89f","Type":"ContainerStarted","Data":"6fb17f7b7236ebeccb13b884de06f185695862665c82659a01a310c66ebfd726"}
Sep 17 17:34:34.807700 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.807675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal" event={"ID":"3564b9943b12f3f32f2d5c68ae2dba3e","Type":"ContainerStarted","Data":"49e77a221d8e11cd412c818e6d9c7ed9390283c7aabad6bebe3bc7e3c20a2d74"}
Sep 17 17:34:34.848814 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-log-socket\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.848896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-netd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.848896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb146d57-9f25-468d-8676-ab37786ff2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.848896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-netns\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-log-socket\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-hostroot\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-hostroot\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-netd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-netns\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.848973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmdb\" (UniqueName: \"kubernetes.io/projected/8c0e73f1-9be5-45ef-9f57-85494a346503-kube-api-access-8fmdb\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.849049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-tmp-dir\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzmj\" (UniqueName: \"kubernetes.io/projected/a36a4e87-d8e8-4814-a87f-da58c1c478e9-kube-api-access-kbzmj\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-system-cni-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysconfig\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-var-lib-kubelet\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-tuned\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-cnibin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5a49f-56e1-49ac-9b59-d621137a02fc-konnectivity-ca\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-tmp-dir\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysconfig\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-var-lib-kubelet\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-daemon-config\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-hosts-file\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-cnibin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7a5a49f-56e1-49ac-9b59-d621137a02fc-agent-certs\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9mq\" (UniqueName: \"kubernetes.io/projected/ae36ae40-d704-46ac-af5d-2d102b25cb51-kube-api-access-lt9mq\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-script-lib\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-conf\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-cni-binary-copy\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-hosts-file\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjps\" (UniqueName: \"kubernetes.io/projected/e901ce13-a6bc-4bec-9ef9-80933789d83b-kube-api-access-kcjps\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.849787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-etc-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-system-cni-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-multus\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.849825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-multus\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-kubernetes\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-kubelet-config\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-conf-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7a5a49f-56e1-49ac-9b59-d621137a02fc-konnectivity-ca\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-multus-certs\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-daemon-config\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-slash\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-node-log\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-config\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-etc-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4s8\" (UniqueName: \"kubernetes.io/projected/4e1d621b-1890-4f19-a63a-1ae86ce5a163-kube-api-access-pq4s8\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-systemd-units\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.850523 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-script-lib\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-var-lib-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-node-log\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-modprobe-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-kubernetes\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a36a4e87-d8e8-4814-a87f-da58c1c478e9-host\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-slash\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a36a4e87-d8e8-4814-a87f-da58c1c478e9-host\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-system-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-conf-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-systemd-units\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-var-lib-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-multus-certs\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-modprobe-d\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-sysctl-conf\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.851350 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-system-cni-dir\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zr5j\" (UniqueName: \"kubernetes.io/projected/bb146d57-9f25-468d-8676-ab37786ff2b6-kube-api-access-5zr5j\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-host\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-k8s-cni-cncf-io\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-cnibin\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.850952    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.850965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-systemd\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.851004    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:35.35098723 +0000 UTC m=+4.657873222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c0e73f1-9be5-45ef-9f57-85494a346503-iptables-alerter-script\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-systemd\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-kubelet\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-bin\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-env-overrides\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a36a4e87-d8e8-4814-a87f-da58c1c478e9-serviceca\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-bin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-sys\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-lib-modules\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-systemd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-dbus\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpghm\" (UniqueName: \"kubernetes.io/projected/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-kube-api-access-vpghm\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-host\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-ovn\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-kubelet-config\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-cni-bin\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-run-k8s-cni-cncf-io\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e901ce13-a6bc-4bec-9ef9-80933789d83b-cni-binary-copy\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-run\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9042abd-a685-4928-9802-0a0e4fa84d8f-dbus\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae36ae40-d704-46ac-af5d-2d102b25cb51-cnibin\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-tmp\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.852908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-kubelet\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c0e73f1-9be5-45ef-9f57-85494a346503-host-slash\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-binary-copy\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-lib-modules\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-socket-dir-parent\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-etc-kubernetes\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c0e73f1-9be5-45ef-9f57-85494a346503-host-slash\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-multus-socket-dir-parent\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-netns\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-ovn\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.851435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-ovnkube-config\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852264    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c0e73f1-9be5-45ef-9f57-85494a346503-iptables-alerter-script\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-binary-copy\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852351    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-run\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.853659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-etc-kubernetes\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-systemd\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-run-netns\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e1d621b-1890-4f19-a63a-1ae86ce5a163-sys\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-kubelet\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-host-cni-bin\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e901ce13-a6bc-4bec-9ef9-80933789d83b-host-var-lib-kubelet\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb146d57-9f25-468d-8676-ab37786ff2b6-run-openvswitch\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a36a4e87-d8e8-4814-a87f-da58c1c478e9-serviceca\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb146d57-9f25-468d-8676-ab37786ff2b6-env-overrides\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.852863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae36ae40-d704-46ac-af5d-2d102b25cb51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.853884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-tmp\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.854260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.853997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e1d621b-1890-4f19-a63a-1ae86ce5a163-etc-tuned\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.858205 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.858182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb146d57-9f25-468d-8676-ab37786ff2b6-ovn-node-metrics-cert\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.859448 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.859404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7a5a49f-56e1-49ac-9b59-d621137a02fc-agent-certs\") pod \"konnectivity-agent-849lz\" (UID: \"c7a5a49f-56e1-49ac-9b59-d621137a02fc\") " pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:34.863246 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.863223    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:34.863327 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.863263    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:34.863327 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.863277    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:34.863423 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:34.863344    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:34:35.363327203 +0000 UTC m=+4.670213194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:34.865403 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmdb\" (UniqueName: \"kubernetes.io/projected/8c0e73f1-9be5-45ef-9f57-85494a346503-kube-api-access-8fmdb\") pod \"iptables-alerter-xhsj8\" (UID: \"8c0e73f1-9be5-45ef-9f57-85494a346503\") " pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.865521 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9mq\" (UniqueName: \"kubernetes.io/projected/ae36ae40-d704-46ac-af5d-2d102b25cb51-kube-api-access-lt9mq\") pod \"multus-additional-cni-plugins-rq9mv\" (UID: \"ae36ae40-d704-46ac-af5d-2d102b25cb51\") " pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.865521 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4s8\" (UniqueName: \"kubernetes.io/projected/4e1d621b-1890-4f19-a63a-1ae86ce5a163-kube-api-access-pq4s8\") pod \"tuned-n5lkw\" (UID: \"4e1d621b-1890-4f19-a63a-1ae86ce5a163\") " pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:34.865521 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zr5j\" (UniqueName: \"kubernetes.io/projected/bb146d57-9f25-468d-8676-ab37786ff2b6-kube-api-access-5zr5j\") pod \"ovnkube-node-q9bgc\" (UID: \"bb146d57-9f25-468d-8676-ab37786ff2b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:34.866516 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjps\" (UniqueName: \"kubernetes.io/projected/e901ce13-a6bc-4bec-9ef9-80933789d83b-kube-api-access-kcjps\") pod \"multus-ppzvm\" (UID: \"e901ce13-a6bc-4bec-9ef9-80933789d83b\") " pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.866516 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.865826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzmj\" (UniqueName: \"kubernetes.io/projected/a36a4e87-d8e8-4814-a87f-da58c1c478e9-kube-api-access-kbzmj\") pod \"node-ca-6smjf\" (UID: \"a36a4e87-d8e8-4814-a87f-da58c1c478e9\") " pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.866516 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.866038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpghm\" (UniqueName: \"kubernetes.io/projected/d046e3fc-29d6-405e-a0d2-5d6419a5a71e-kube-api-access-vpghm\") pod \"node-resolver-dqxrl\" (UID: \"d046e3fc-29d6-405e-a0d2-5d6419a5a71e\") " pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:34.947457 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.947399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv"
Sep 17 17:34:34.963218 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.963199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6smjf"
Sep 17 17:34:34.971910 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.971881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ppzvm"
Sep 17 17:34:34.979562 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.979542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhsj8"
Sep 17 17:34:34.987244 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.987228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rq9mv"
Sep 17 17:34:34.995613 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:34.995593    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:35.001635 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.001619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5lkw"
Sep 17 17:34:35.009091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.009070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:35.014452 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.014433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dqxrl"
Sep 17 17:34:35.065413 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.065392    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:35.256589 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.256508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:35.256728 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.256639    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:35.256728 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.256710    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.256687844 +0000 UTC m=+5.563573860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:35.357802 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.357774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:35.357956 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.357908    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:35.358021 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.357983    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.357961731 +0000 UTC m=+5.664847739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:35.458239 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.458206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:35.458430 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.458408    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:35.458496 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.458443    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:35.458496 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.458457    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:35.458589 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:35.458538    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:34:36.458518898 +0000 UTC m=+5.765404891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:35.632971 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:35.632943    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0e73f1_9be5_45ef_9f57_85494a346503.slice/crio-7e62a8bc749006354197d1cf4b3d50c71322fc8eed2fc99f491a3dc13ff40c47 WatchSource:0}: Error finding container 7e62a8bc749006354197d1cf4b3d50c71322fc8eed2fc99f491a3dc13ff40c47: Status 404 returned error can't find the container with id 7e62a8bc749006354197d1cf4b3d50c71322fc8eed2fc99f491a3dc13ff40c47
Sep 17 17:34:35.634043 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:35.633982    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a5a49f_56e1_49ac_9b59_d621137a02fc.slice/crio-0a0aea956356da2426aa6d3e43c51005c324f1520ca7f877cf0f062af4cdcc4d WatchSource:0}: Error finding container 0a0aea956356da2426aa6d3e43c51005c324f1520ca7f877cf0f062af4cdcc4d: Status 404 returned error can't find the container with id 0a0aea956356da2426aa6d3e43c51005c324f1520ca7f877cf0f062af4cdcc4d
Sep 17 17:34:35.634885 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:35.634747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd046e3fc_29d6_405e_a0d2_5d6419a5a71e.slice/crio-48d3bbbd6ca5bc8bd833e1c0c26773ea4d4206ac2b0aae28ddf313250c674013 WatchSource:0}: Error finding container 48d3bbbd6ca5bc8bd833e1c0c26773ea4d4206ac2b0aae28ddf313250c674013: Status 404 returned error can't find the container with id 48d3bbbd6ca5bc8bd833e1c0c26773ea4d4206ac2b0aae28ddf313250c674013
Sep 17 17:34:35.636100 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:35.636034    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae36ae40_d704_46ac_af5d_2d102b25cb51.slice/crio-e1e422dec9c38af3a8c7d29f2a4c0c64a8ff7c9b3221e8c88e13c644c547fad3 WatchSource:0}: Error finding container e1e422dec9c38af3a8c7d29f2a4c0c64a8ff7c9b3221e8c88e13c644c547fad3: Status 404 returned error can't find the container with id e1e422dec9c38af3a8c7d29f2a4c0c64a8ff7c9b3221e8c88e13c644c547fad3
Sep 17 17:34:35.636604 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:34:35.636542    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7678c1cf_cd4e_499d_9e7c_99813338f96a.slice/crio-c89530c28c33969cf7f278c45c7f781f745114658fd9264c008b9c3dfb8b16d7 WatchSource:0}: Error finding container c89530c28c33969cf7f278c45c7f781f745114658fd9264c008b9c3dfb8b16d7: Status 404 returned error can't find the container with id c89530c28c33969cf7f278c45c7f781f745114658fd9264c008b9c3dfb8b16d7
Sep 17 17:34:35.692058 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.692033    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:34 +0000 UTC" deadline="2028-05-24 07:20:58.80366769 +0000 UTC"
Sep 17 17:34:35.692058 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.692056    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14749h46m23.111614221s"
Sep 17 17:34:35.811380 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.811251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal" event={"ID":"3564b9943b12f3f32f2d5c68ae2dba3e","Type":"ContainerStarted","Data":"21b139b2dd775d0c8d4aa46bff631a01aeb1f79d342f3f0026ddf6fdb0a289f2"}
Sep 17 17:34:35.812395 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.812374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ppzvm" event={"ID":"e901ce13-a6bc-4bec-9ef9-80933789d83b","Type":"ContainerStarted","Data":"8eb831fed2885f57393933abf25ee346d54a88a03b8737ac94c5fa5a7e119c92"}
Sep 17 17:34:35.814532 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.814504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerStarted","Data":"e1e422dec9c38af3a8c7d29f2a4c0c64a8ff7c9b3221e8c88e13c644c547fad3"}
Sep 17 17:34:35.816390 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.816372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv" event={"ID":"7678c1cf-cd4e-499d-9e7c-99813338f96a","Type":"ContainerStarted","Data":"c89530c28c33969cf7f278c45c7f781f745114658fd9264c008b9c3dfb8b16d7"}
Sep 17 17:34:35.817539 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.817514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dqxrl" event={"ID":"d046e3fc-29d6-405e-a0d2-5d6419a5a71e","Type":"ContainerStarted","Data":"48d3bbbd6ca5bc8bd833e1c0c26773ea4d4206ac2b0aae28ddf313250c674013"}
Sep 17 17:34:35.818525 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.818497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5lkw" event={"ID":"4e1d621b-1890-4f19-a63a-1ae86ce5a163","Type":"ContainerStarted","Data":"17bf0ed2818c8c90c9a7ea0ce97fe5ec287eee25d7a87159b4e4bf329e55f48e"}
Sep 17 17:34:35.819647 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.819625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-849lz" event={"ID":"c7a5a49f-56e1-49ac-9b59-d621137a02fc","Type":"ContainerStarted","Data":"0a0aea956356da2426aa6d3e43c51005c324f1520ca7f877cf0f062af4cdcc4d"}
Sep 17 17:34:35.820771 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.820749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhsj8" event={"ID":"8c0e73f1-9be5-45ef-9f57-85494a346503","Type":"ContainerStarted","Data":"7e62a8bc749006354197d1cf4b3d50c71322fc8eed2fc99f491a3dc13ff40c47"}
Sep 17 17:34:35.822043 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.822017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"a27e53fe530e88feac957f716d51774aa07ce75f44499845dbfde744dedae328"}
Sep 17 17:34:35.822975 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.822959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6smjf" event={"ID":"a36a4e87-d8e8-4814-a87f-da58c1c478e9","Type":"ContainerStarted","Data":"43b948f0fbd43a8ee8d968d8badc115f65b0a35c28a2efa66060c595d72d905a"}
Sep 17 17:34:35.875376 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:35.875336    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-158.ec2.internal" podStartSLOduration=1.875324502 podStartE2EDuration="1.875324502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:35.874925964 +0000 UTC m=+5.181811981" watchObservedRunningTime="2026-09-17 17:34:35.875324502 +0000 UTC m=+5.182210514"
Sep 17 17:34:36.266508 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.265077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:36.266508 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.265241    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:36.266508 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.265296    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:38.265280259 +0000 UTC m=+7.572166256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:36.366030 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.365993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:36.366201 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.366154    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:36.366261 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.366216    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:38.366198709 +0000 UTC m=+7.673084706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:36.467152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.467117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:36.467315 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.467269    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:36.467315 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.467289    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:36.467315 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.467300    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:36.467464 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.467352    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:34:38.467335061 +0000 UTC m=+7.774221054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:36.692802 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.692719    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:34 +0000 UTC" deadline="2028-04-09 08:51:40.252152894 +0000 UTC"
Sep 17 17:34:36.692802 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.692760    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13671h17m3.559398435s"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.809064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.809276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.809420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.810149    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.810313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:36.813382 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:36.810444    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:36.867233 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.866223    2581 generic.go:356] "Generic (PLEG): container finished" podID="a92dd837ac005c2b7d676a0a2ed0d89f" containerID="74857daf278ed88566d68c2a2ce0736a818c19dd5fced8e5fd31c5d23f2e084d" exitCode=0
Sep 17 17:34:36.867233 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:36.867141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal" event={"ID":"a92dd837ac005c2b7d676a0a2ed0d89f","Type":"ContainerDied","Data":"74857daf278ed88566d68c2a2ce0736a818c19dd5fced8e5fd31c5d23f2e084d"}
Sep 17 17:34:37.887732 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:37.887694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal" event={"ID":"a92dd837ac005c2b7d676a0a2ed0d89f","Type":"ContainerStarted","Data":"52092716b236cdbe9589a7415c94200d49fc934dd1c063a683058a8d905ba1db"}
Sep 17 17:34:37.915777 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:37.915129    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-158.ec2.internal" podStartSLOduration=3.91510949 podStartE2EDuration="3.91510949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.913322797 +0000 UTC m=+7.220208810" watchObservedRunningTime="2026-09-17 17:34:37.91510949 +0000 UTC m=+7.221995504"
Sep 17 17:34:38.283806 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.283714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:38.283967 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.283907    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:38.283967 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.283964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:42.283947967 +0000 UTC m=+11.590833966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:38.385062 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.384463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:38.385062 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.384681    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:38.385062 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.384740    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:42.384723397 +0000 UTC m=+11.691609403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:38.485772 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.485130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:38.485772 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.485295    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:38.485772 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.485317    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:38.485772 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.485331    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:38.485772 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.485389    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:34:42.485370977 +0000 UTC m=+11.792256985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:38.804610 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.804578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:38.804610 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.804597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:38.804847 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:38.804583    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:38.804847 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.804753    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:38.804847 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.804823    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:38.805003 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:38.804920    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:40.803915 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:40.803885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:40.804327 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:40.804025    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:40.804399 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:40.804376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:40.804521 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:40.804472    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:40.804653 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:40.804634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:40.804811 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:40.804722    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:42.317142 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.317108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:42.317659 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.317248    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:42.317659 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.317327    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.317305973 +0000 UTC m=+19.624191969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:42.418420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.418383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:42.418611 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.418587    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:42.418741 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.418643    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.4186266 +0000 UTC m=+19.725512594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:42.518821 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.518774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:42.518971 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.518937    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:42.518971 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.518958    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:42.518971 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.518970    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:42.519092 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.519023    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.51900496 +0000 UTC m=+19.825890963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:42.803298 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.803217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:42.803547 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.803320    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:42.803547 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.803346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:42.803547 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:42.803376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:42.803547 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.803521    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:42.803753 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:42.803604    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:44.802491 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:44.802440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:44.802491 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:44.802491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:44.802944 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:44.802445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:44.802944 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:44.802585    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:44.802944 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:44.802643    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:44.802944 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:44.802724    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:46.802298 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:46.802265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:46.802718 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:46.802271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:46.802718 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:46.802364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:46.802718 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:46.802391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:46.802718 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:46.802470    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:46.802718 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:46.802595    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:48.805432 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:48.805407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:48.805822 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:48.805521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:48.805822 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:48.805533    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:48.805822 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:48.805614    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:48.805822 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:48.805661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:48.805822 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:48.805729    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:50.375627 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.375595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:50.376116 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.375700    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:50.376116 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.375750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:06.375736959 +0000 UTC m=+35.682622954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:50.476284 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.476239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:50.476451 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.476377    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:50.476531 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.476468    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:06.47644856 +0000 UTC m=+35.783334551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:50.576903 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.576865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:50.577066 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.577035    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:50.577066 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.577054    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:50.577066 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.577063    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:50.577234 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.577129    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:35:06.577112979 +0000 UTC m=+35.883998973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:50.803177 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.803098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:50.803177 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.803100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:50.803381 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.803240    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:50.803381 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:50.803268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:50.803447 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.803415    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:50.803511 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:50.803495    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:52.802828 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:52.802801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:52.803160 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:52.802867    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:52.803160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:52.802872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:52.803160 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:52.802915    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:52.803160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:52.802924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:52.803160 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:52.803028    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:53.919848 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.919503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ppzvm" event={"ID":"e901ce13-a6bc-4bec-9ef9-80933789d83b","Type":"ContainerStarted","Data":"67223b544eea4eef239dcd7f2f28b1a07c4fcf3fb982e69933ef441735d09559"}
Sep 17 17:34:53.921014 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.920991    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="3cb3b498191fc1b3e8c426a89b11b36c0cbc7a861581cc8d14d59d7c2bfe66e5" exitCode=0
Sep 17 17:34:53.921110 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.921070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"3cb3b498191fc1b3e8c426a89b11b36c0cbc7a861581cc8d14d59d7c2bfe66e5"}
Sep 17 17:34:53.922625 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.922602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv" event={"ID":"7678c1cf-cd4e-499d-9e7c-99813338f96a","Type":"ContainerStarted","Data":"824f329a4286443e5d15f0138fead13a556b97e2cf743fc17f9f86d4508211ad"}
Sep 17 17:34:53.924097 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.924070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dqxrl" event={"ID":"d046e3fc-29d6-405e-a0d2-5d6419a5a71e","Type":"ContainerStarted","Data":"bd87bbede88d1b032f627e45c1a8f6d27a68fcf2229bf06432d6a609555b1162"}
Sep 17 17:34:53.925432 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.925400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5lkw" event={"ID":"4e1d621b-1890-4f19-a63a-1ae86ce5a163","Type":"ContainerStarted","Data":"4b0f525512d493bb556a3e2fc9c5a9b6a151b43fafa7f3329bc89c06e1170904"}
Sep 17 17:34:53.926751 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.926691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-849lz" event={"ID":"c7a5a49f-56e1-49ac-9b59-d621137a02fc","Type":"ContainerStarted","Data":"58f97c364bd8f1fdc6b75f66aa4d2b0d96d8a9e21eee64d1eb92e18796dacfc0"}
Sep 17 17:34:53.929637 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.929622    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:34:53.929934 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.929917    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb146d57-9f25-468d-8676-ab37786ff2b6" containerID="2d804c502957e53cae2d6efa6f90522db5d1e861ca0b75dfea96630e963cf2a0" exitCode=1
Sep 17 17:34:53.930000 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.929982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"353f5021cc5bfd66a9ca73acd7e04cc3be2cf39ad46867202c7b6e906f7b45e0"}
Sep 17 17:34:53.930048 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.930038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"ccabcc1219d4c7e5d0b47c610d91a608954d591e5cb643c678a7cab6d66425bb"}
Sep 17 17:34:53.930096 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.930085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"3ebabfa111170a19d6ac38b2468fad1c598e9502596be96877f472000a9c80f0"}
Sep 17 17:34:53.930141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.930133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"f0f342c73682ec22b28c7ffaa59e49dee2949bda91624bdaf152c3c0f10fea7c"}
Sep 17 17:34:53.930191 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.930178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerDied","Data":"2d804c502957e53cae2d6efa6f90522db5d1e861ca0b75dfea96630e963cf2a0"}
Sep 17 17:34:53.930242 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.930230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"604df6820bda073fcbba0c7ad895dbd354a78791c8fa84a23f282888a4a57e81"}
Sep 17 17:34:53.931302 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.931285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6smjf" event={"ID":"a36a4e87-d8e8-4814-a87f-da58c1c478e9","Type":"ContainerStarted","Data":"6c0eb307476258bf37550014038d423600e84f0f96879aab975bed21ba5797be"}
Sep 17 17:34:53.939440 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.939405    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ppzvm" podStartSLOduration=4.705665557 podStartE2EDuration="21.939379795s" totalImagesPullingTime="17.233714238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:53.938521719 +0000 UTC m=+23.245407731" watchObservedRunningTime="2026-09-17 17:34:53.939379795 +0000 UTC m=+23.246265806"
Sep 17 17:34:53.977925 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:53.977893    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6smjf" podStartSLOduration=4.8504334 podStartE2EDuration="21.977881784s" totalImagesPullingTime="17.127448384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:53.95490705 +0000 UTC m=+23.261793062" watchObservedRunningTime="2026-09-17 17:34:53.977881784 +0000 UTC m=+23.284767796"
Sep 17 17:34:54.034561 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.033441    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n5lkw" podStartSLOduration=4.830508049 podStartE2EDuration="22.033422927s" totalImagesPullingTime="17.202914878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:53.978055799 +0000 UTC m=+23.284941812" watchObservedRunningTime="2026-09-17 17:34:54.033422927 +0000 UTC m=+23.340308942"
Sep 17 17:34:54.109858 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.109821    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-849lz" podStartSLOduration=5.237971534 podStartE2EDuration="22.109809008s" totalImagesPullingTime="16.871837474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:54.063921202 +0000 UTC m=+23.370807216" watchObservedRunningTime="2026-09-17 17:34:54.109809008 +0000 UTC m=+23.416695024"
Sep 17 17:34:54.161932 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.161905    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 17:34:54.242450 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.242424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:54.360141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.360114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:54.455957 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.455899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:54.719515 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.718990    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:34:54.161924306Z","UUID":"f2a04c99-5d2d-4a3a-91e3-221f9921063d","Handler":null,"Name":"","Endpoint":""}
Sep 17 17:34:54.720808 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.720777    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 17:34:54.720808 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.720811    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 17:34:54.802166 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.802109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:54.802166 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.802134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:54.802394 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.802119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:54.802394 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:54.802225    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:54.802394 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:54.802321    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:54.802394 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:54.802363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:54.935659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.935625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv" event={"ID":"7678c1cf-cd4e-499d-9e7c-99813338f96a","Type":"ContainerStarted","Data":"1a46f57bfae5814fe8f0c68a73426b2977e71c4916c86f09f49c1440da5c6a48"}
Sep 17 17:34:54.937400 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.937367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhsj8" event={"ID":"8c0e73f1-9be5-45ef-9f57-85494a346503","Type":"ContainerStarted","Data":"c23e5b0dbc3650119c0f446f06b9d1b8c21c740f98e29485ae71ce78ee0296b3"}
Sep 17 17:34:54.960188 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.960144    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dqxrl" podStartSLOduration=5.764207471 podStartE2EDuration="22.96012587s" totalImagesPullingTime="17.195918399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:54.110196641 +0000 UTC m=+23.417082653" watchObservedRunningTime="2026-09-17 17:34:54.96012587 +0000 UTC m=+24.267011901"
Sep 17 17:34:54.960636 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:54.960606    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xhsj8" podStartSLOduration=5.839758843 podStartE2EDuration="22.96059696s" totalImagesPullingTime="17.120838117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:54.960104919 +0000 UTC m=+24.266990947" watchObservedRunningTime="2026-09-17 17:34:54.96059696 +0000 UTC m=+24.267482972"
Sep 17 17:34:55.091940 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.091905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:55.163921 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.163891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:55.243918 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.243823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:55.395971 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.395895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:55.467848 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.467813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:55.942460 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.942402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv" event={"ID":"7678c1cf-cd4e-499d-9e7c-99813338f96a","Type":"ContainerStarted","Data":"78e25e1bd09f72eff98a4a97d56d585ea6311293d25fbdf756478f18f2da851e"}
Sep 17 17:34:55.946639 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.946620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:34:55.968372 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:55.968301    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ncnv" podStartSLOduration=4.9509699529999995 podStartE2EDuration="23.968281388s" totalImagesPullingTime="19.017311435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:55.967958387 +0000 UTC m=+25.274844401" watchObservedRunningTime="2026-09-17 17:34:55.968281388 +0000 UTC m=+25.275167403"
Sep 17 17:34:56.802353 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.802291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:56.802353 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.802309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:56.802596 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:56.802414    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:56.802596 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:56.802532    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:56.802596 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.802584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:56.802731 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:56.802681    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:56.829378 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.829356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:56.829906 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.829890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:56.952568 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.952545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:34:56.952973 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.952947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"cad33eb1baa36f6f64fa2a80a674c1979c0ce9419ec4fae51873c0f2932914e4"}
Sep 17 17:34:56.953353 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.953335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:56.953880 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:56.953865    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-849lz"
Sep 17 17:34:57.076569 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:57.076503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:34:57.957243 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:57.957112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerStarted","Data":"2b8e8567090f194dd536a9148fcae02ef427afabe01960725b50fddf048931ab"}
Sep 17 17:34:58.803005 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.802841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:34:58.803164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.802841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:34:58.803164 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:58.803079    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:34:58.803164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.802846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:34:58.803297 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:58.803167    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:34:58.803297 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:34:58.803219    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:34:58.961904 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.961884    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:34:58.962518 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.962245    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"3d5f49b0671457bb9c84808188c0087ba7e7e36c69e17d9e09849210000f919a"}
Sep 17 17:34:58.962518 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.962452    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:58.962672 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.962655    2581 scope.go:117] "RemoveContainer" containerID="2d804c502957e53cae2d6efa6f90522db5d1e861ca0b75dfea96630e963cf2a0"
Sep 17 17:34:58.964412 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.964384    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="2b8e8567090f194dd536a9148fcae02ef427afabe01960725b50fddf048931ab" exitCode=0
Sep 17 17:34:58.964524 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.964472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"2b8e8567090f194dd536a9148fcae02ef427afabe01960725b50fddf048931ab"}
Sep 17 17:34:58.980157 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:58.980139    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:59.971053 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:59.971028    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:34:59.971442 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:59.971396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" event={"ID":"bb146d57-9f25-468d-8676-ab37786ff2b6","Type":"ContainerStarted","Data":"b4c55afeb70ee510b5b1d53a615ba97948f8bd2f4bb087ca570db3063c74e2dd"}
Sep 17 17:34:59.971662 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:59.971644    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:59.971778 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:59.971699    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:34:59.986278 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:34:59.986256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:35:00.060672 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.060631    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc" podStartSLOduration=10.839817126 podStartE2EDuration="28.060615441s" totalImagesPullingTime="17.220798315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:00.016259311 +0000 UTC m=+29.323145323" watchObservedRunningTime="2026-09-17 17:35:00.060615441 +0000 UTC m=+29.367501453"
Sep 17 17:35:00.360249 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.360225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lh6dh"]
Sep 17 17:35:00.360381 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.360366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:00.360587 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:00.360516    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:35:00.364914 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.364890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d49h2"]
Sep 17 17:35:00.365034 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.365018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:00.365166 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:00.365136    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:35:00.365387 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.365370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt72c"]
Sep 17 17:35:00.365457 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.365447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:00.365547 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:00.365532    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:35:00.975482 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.975455    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="1fd0cc7a0eed70d33965a114d25439419c2addc80402b0bd728e2447c880ab84" exitCode=0
Sep 17 17:35:00.975797 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:00.975543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"1fd0cc7a0eed70d33965a114d25439419c2addc80402b0bd728e2447c880ab84"}
Sep 17 17:35:01.802495 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:01.802449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:01.802495 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:01.802493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:01.802718 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:01.802574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:01.802718 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:01.802587    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:35:01.802718 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:01.802639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:35:01.802864 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:01.802745    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:35:02.982340 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:02.982279    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="1adb5ed3ea4b5a8ecedf3e107261a0568da22fed749ca98f04d7192472e44069" exitCode=0
Sep 17 17:35:02.982340 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:02.982326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"1adb5ed3ea4b5a8ecedf3e107261a0568da22fed749ca98f04d7192472e44069"}
Sep 17 17:35:03.802667 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:03.802636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:03.802843 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:03.802742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:03.802843 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:03.802756    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:35:03.802843 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:03.802765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:03.802998 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:03.802849    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:35:03.802998 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:03.802957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:35:05.802137 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:05.802100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:05.802756 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:05.802144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:05.802756 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:05.802219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:05.802756 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:05.802230    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt72c" podUID="c5cb440e-3068-46d8-ab56-1b9fb6fff3da"
Sep 17 17:35:05.802756 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:05.802302    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh6dh" podUID="c9042abd-a685-4928-9802-0a0e4fa84d8f"
Sep 17 17:35:05.802756 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:05.802388    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d49h2" podUID="49f5f083-0838-433b-b94d-3d5d37b65797"
Sep 17 17:35:06.068415 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.068384    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-158.ec2.internal" event="NodeReady"
Sep 17 17:35:06.068574 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.068542    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 17:35:06.135454 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.135424    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-22ktf"]
Sep 17 17:35:06.164496 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.164442    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j7hfk"]
Sep 17 17:35:06.164657 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.164591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.168005 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.167983    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 17:35:06.168005 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.167995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 17:35:06.168557 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.168510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gbrs5\""
Sep 17 17:35:06.182539 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.182517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22ktf"]
Sep 17 17:35:06.182647 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.182552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j7hfk"]
Sep 17 17:35:06.182647 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.182573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.189661 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.189642    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 17:35:06.189965 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.189917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 17:35:06.190077 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.190059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2tbmw\""
Sep 17 17:35:06.190141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.190127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 17:35:06.293290 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmw2c\" (UniqueName: \"kubernetes.io/projected/0e8d3677-ee10-4607-be7c-930124be8e52-kube-api-access-xmw2c\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.293423 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8d3677-ee10-4607-be7c-930124be8e52-config-volume\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.293423 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/0ef46462-a0b3-46ed-a772-01f4d6fa5771-kube-api-access-5gmcv\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.293423 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.293423 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8d3677-ee10-4607-be7c-930124be8e52-tmp-dir\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.293591 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.293522    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef46462-a0b3-46ed-a772-01f4d6fa5771-cert\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.352737 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.352663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:06.394146 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmw2c\" (UniqueName: \"kubernetes.io/projected/0e8d3677-ee10-4607-be7c-930124be8e52-kube-api-access-xmw2c\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8d3677-ee10-4607-be7c-930124be8e52-config-volume\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/0ef46462-a0b3-46ed-a772-01f4d6fa5771-kube-api-access-5gmcv\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.394266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8d3677-ee10-4607-be7c-930124be8e52-tmp-dir\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:06.394509 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef46462-a0b3-46ed-a772-01f4d6fa5771-cert\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.394629 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.394607    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:35:06.394678 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8d3677-ee10-4607-be7c-930124be8e52-tmp-dir\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394678 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.394676    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:38.394662321 +0000 UTC m=+67.701548312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:35:06.394746 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.394613    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:06.394780 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.394743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8d3677-ee10-4607-be7c-930124be8e52-config-volume\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.394780 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.394773    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:06.894756386 +0000 UTC m=+36.201642378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:06.398886 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.398867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef46462-a0b3-46ed-a772-01f4d6fa5771-cert\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.407621 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.407601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmw2c\" (UniqueName: \"kubernetes.io/projected/0e8d3677-ee10-4607-be7c-930124be8e52-kube-api-access-xmw2c\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.408223 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.408205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/0ef46462-a0b3-46ed-a772-01f4d6fa5771-kube-api-access-5gmcv\") pod \"ingress-canary-j7hfk\" (UID: \"0ef46462-a0b3-46ed-a772-01f4d6fa5771\") " pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.453443 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.453409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:06.491946 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.491924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j7hfk"
Sep 17 17:35:06.495233 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.495212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:06.495340 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.495326    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:35:06.495398 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.495387    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret podName:c9042abd-a685-4928-9802-0a0e4fa84d8f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:38.495370545 +0000 UTC m=+67.802256540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret") pod "global-pull-secret-syncer-lh6dh" (UID: "c9042abd-a685-4928-9802-0a0e4fa84d8f") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:35:06.596617 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.596591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:06.596781 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.596722    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:35:06.596781 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.596743    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:35:06.596781 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.596756    2581 projected.go:196] Error preparing data for projected volume kube-api-access-7mzdx for pod openshift-network-diagnostics/network-check-target-wt72c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:35:06.596927 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.596809    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx podName:c5cb440e-3068-46d8-ab56-1b9fb6fff3da nodeName:}" failed. No retries permitted until 2026-09-17 17:35:38.596791863 +0000 UTC m=+67.903677874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7mzdx" (UniqueName: "kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx") pod "network-check-target-wt72c" (UID: "c5cb440e-3068-46d8-ab56-1b9fb6fff3da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:35:06.898972 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:06.898938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:06.899492 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.899069    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:06.899492 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:06.899154    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:07.89912782 +0000 UTC m=+37.206013824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:07.126740 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.126618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j7hfk"]
Sep 17 17:35:07.129166 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:35:07.129146    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef46462_a0b3_46ed_a772_01f4d6fa5771.slice/crio-fb8274febd89f0c49afb69f90b1424bfc0b4b819d32251a2fe557d852b4b38e2 WatchSource:0}: Error finding container fb8274febd89f0c49afb69f90b1424bfc0b4b819d32251a2fe557d852b4b38e2: Status 404 returned error can't find the container with id fb8274febd89f0c49afb69f90b1424bfc0b4b819d32251a2fe557d852b4b38e2
Sep 17 17:35:07.802794 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.802767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:07.802794 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.802786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:07.803080 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.802765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:07.807865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.807846    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:35:07.808072 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.808053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:35:07.809160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.809138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2vf4\""
Sep 17 17:35:07.818066 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.817782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:35:07.818066 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.817854    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:35:07.818212 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.818112    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xc26q\""
Sep 17 17:35:07.905993 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.905960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:07.906327 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:07.906062    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:07.906327 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:07.906113    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:09.906100155 +0000 UTC m=+39.212986146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:07.996223 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.996194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j7hfk" event={"ID":"0ef46462-a0b3-46ed-a772-01f4d6fa5771","Type":"ContainerStarted","Data":"fb8274febd89f0c49afb69f90b1424bfc0b4b819d32251a2fe557d852b4b38e2"}
Sep 17 17:35:07.999355 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.999326    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="cd6b50c0c29abf8cc280a87228ddecae7ac2377583e3312253b7b89dfc0462b4" exitCode=0
Sep 17 17:35:07.999457 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:07.999377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"cd6b50c0c29abf8cc280a87228ddecae7ac2377583e3312253b7b89dfc0462b4"}
Sep 17 17:35:08.224268 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:08.224242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:08.325775 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:08.325709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:08.453603 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:08.453571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:09.006279 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.006231    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae36ae40-d704-46ac-af5d-2d102b25cb51" containerID="c54ed018b3362c6fc6ed145506f13885d81b13b9370f0f7b959a3ef4a6138ab0" exitCode=0
Sep 17 17:35:09.006771 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.006320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerDied","Data":"c54ed018b3362c6fc6ed145506f13885d81b13b9370f0f7b959a3ef4a6138ab0"}
Sep 17 17:35:09.194917 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.194885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:09.295646 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.295584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:09.923426 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.923275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:09.923426 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:09.923416    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:09.923655 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:09.923489    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:13.923461508 +0000 UTC m=+43.230347503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:09.977620 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:09.977591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:10.011671 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.011648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" event={"ID":"ae36ae40-d704-46ac-af5d-2d102b25cb51","Type":"ContainerStarted","Data":"30c606c1d2e7567684d7a25474100636ac4e94e0596cf766ffde882683122193"}
Sep 17 17:35:10.013172 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.013151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j7hfk" event={"ID":"0ef46462-a0b3-46ed-a772-01f4d6fa5771","Type":"ContainerStarted","Data":"c06a847007832d6463e57183324909dc9443c9af45a60860b77fdb0f6018b4f1"}
Sep 17 17:35:10.039156 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.039105    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rq9mv" podStartSLOduration=10.334295843 podStartE2EDuration="38.039086201s" totalImagesPullingTime="27.704790358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:10.037464696 +0000 UTC m=+39.344350710" watchObservedRunningTime="2026-09-17 17:35:10.039086201 +0000 UTC m=+39.345972215"
Sep 17 17:35:10.068679 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.067107    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j7hfk" podStartSLOduration=1.909293932 podStartE2EDuration="4.067089653s" totalImagesPullingTime="2.157795721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:10.065062115 +0000 UTC m=+39.371948127" watchObservedRunningTime="2026-09-17 17:35:10.067089653 +0000 UTC m=+39.373975667"
Sep 17 17:35:10.092696 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.092670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:10.209664 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.209607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:10.316137 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:10.316112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:11.907376 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.907349    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"]
Sep 17 17:35:11.908889 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.908874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:11.911011 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.910990    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"]
Sep 17 17:35:11.912428 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.912409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 17:35:11.912637 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.912619    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 17:35:11.912693 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.912652    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 17:35:11.912846 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.912832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:11.913357 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.913341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 17:35:11.916027 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.915976    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 17:35:11.916089 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.916023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 17:35:11.916357 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.916340    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 17:35:11.917086 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.917070    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 17:35:11.927923 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.927904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"]
Sep 17 17:35:11.955856 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:11.955838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"]
Sep 17 17:35:12.037040 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-tmp\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.037124 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037124 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037202 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpm45\" (UniqueName: \"kubernetes.io/projected/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-kube-api-access-fpm45\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.037202 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhr9\" (UniqueName: \"kubernetes.io/projected/9005c12c-3a61-47f0-b5a6-380eb3bdf735-kube-api-access-trhr9\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037202 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037202 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9005c12c-3a61-47f0-b5a6-380eb3bdf735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037327 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.037327 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.037270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.119398 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.119370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:12.138286 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpm45\" (UniqueName: \"kubernetes.io/projected/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-kube-api-access-fpm45\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.138355 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhr9\" (UniqueName: \"kubernetes.io/projected/9005c12c-3a61-47f0-b5a6-380eb3bdf735-kube-api-access-trhr9\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.138355 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.138355 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9005c12c-3a61-47f0-b5a6-380eb3bdf735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.138602 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.138602 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.138602 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-tmp\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.138602 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.138602 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.138546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.139057 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.139026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-tmp\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.139248 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.139226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9005c12c-3a61-47f0-b5a6-380eb3bdf735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.142546 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.142521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-ca\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.142665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.142649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.142699 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.142690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.142867 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.142852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9005c12c-3a61-47f0-b5a6-380eb3bdf735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.142902 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.142873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.148975 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.148948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhr9\" (UniqueName: \"kubernetes.io/projected/9005c12c-3a61-47f0-b5a6-380eb3bdf735-kube-api-access-trhr9\") pod \"cluster-proxy-proxy-agent-f9f784bc4-frvn5\" (UID: \"9005c12c-3a61-47f0-b5a6-380eb3bdf735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.150513 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.150469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpm45\" (UniqueName: \"kubernetes.io/projected/c5aa941d-ec3a-4f40-b2b0-c19d607ae73c-kube-api-access-fpm45\") pod \"klusterlet-addon-workmgr-6b6756b59f-z6w59\" (UID: \"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.219015 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.218970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:12.238725 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.238641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:35:12.501563 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.501501    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"]
Sep 17 17:35:12.505081 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:35:12.505056    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5aa941d_ec3a_4f40_b2b0_c19d607ae73c.slice/crio-d7468395afde25a10ba050620a1524a1fe48a684620e2294f4fddf221b72b5ca WatchSource:0}: Error finding container d7468395afde25a10ba050620a1524a1fe48a684620e2294f4fddf221b72b5ca: Status 404 returned error can't find the container with id d7468395afde25a10ba050620a1524a1fe48a684620e2294f4fddf221b72b5ca
Sep 17 17:35:12.522469 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:12.522440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"]
Sep 17 17:35:12.524674 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:35:12.524653    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9005c12c_3a61_47f0_b5a6_380eb3bdf735.slice/crio-5855bb63745a16a30a3d4ab14fd0c2cabc2b051bce4791477ea3e4ba61cc659c WatchSource:0}: Error finding container 5855bb63745a16a30a3d4ab14fd0c2cabc2b051bce4791477ea3e4ba61cc659c: Status 404 returned error can't find the container with id 5855bb63745a16a30a3d4ab14fd0c2cabc2b051bce4791477ea3e4ba61cc659c
Sep 17 17:35:13.021526 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:13.021472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerStarted","Data":"5855bb63745a16a30a3d4ab14fd0c2cabc2b051bce4791477ea3e4ba61cc659c"}
Sep 17 17:35:13.022812 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:13.022774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" event={"ID":"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c","Type":"ContainerStarted","Data":"d7468395afde25a10ba050620a1524a1fe48a684620e2294f4fddf221b72b5ca"}
Sep 17 17:35:13.951952 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:13.951755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:13.952128 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:13.951913    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:13.952128 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:13.952055    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.952033889 +0000 UTC m=+51.258919883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:15.400744 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:15.400708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:15.500275 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:15.500229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:18.038191 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.038159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerStarted","Data":"fcb352e12ea22bcee7c1887ba0bbf82271b1815499f08ff9c07c1f8088819875"}
Sep 17 17:35:18.038553 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.038213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerStarted","Data":"9ba70767af0eca939b4831ac48ee864fd0a80510f1c4110db66147c3e6735906"}
Sep 17 17:35:18.039899 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.039871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" event={"ID":"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c","Type":"ContainerStarted","Data":"861e063f6883ede9485e4236675dd87aa4bebb5ad8669310b926c7a87ba79abc"}
Sep 17 17:35:18.040141 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.040098    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:18.041644 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.041626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:35:18.061403 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:18.061363    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" podStartSLOduration=1.735163115 podStartE2EDuration="7.061352339s" totalImagesPullingTime="5.326189224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:18.060719499 +0000 UTC m=+47.367605540" watchObservedRunningTime="2026-09-17 17:35:18.061352339 +0000 UTC m=+47.368238352"
Sep 17 17:35:19.044435 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:19.044402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerStarted","Data":"5d9207e5eddfedf05ff14e44a4caf396eaa0715530426cd7a46e4836a8129636"}
Sep 17 17:35:19.067014 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:19.066971    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" podStartSLOduration=2.759097339 podStartE2EDuration="8.066957482s" totalImagesPullingTime="5.307860143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:19.066666428 +0000 UTC m=+48.373552440" watchObservedRunningTime="2026-09-17 17:35:19.066957482 +0000 UTC m=+48.373843497"
Sep 17 17:35:21.375087 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:21.375053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:21.479935 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:21.479899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:22.013559 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:22.013528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:22.013680 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:22.013634    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:22.013713 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:22.013690    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:38.013678378 +0000 UTC m=+67.320564373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:24.259997 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:24.259964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:24.362657 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:24.362619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:24.540311 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:24.540286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:31.988841 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:31.988816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q9bgc"
Sep 17 17:35:32.149400 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:32.149374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:32.219265 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:32.219228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:38.016362 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.016331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:35:38.016769 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:38.016490    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:38.016769 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:38.016546    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:10.016533268 +0000 UTC m=+99.323419259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:38.418444 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.418417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:35:38.421368 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.421349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:35:38.428988 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:38.428970    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:35:38.429045 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:35:38.429014    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs podName:49f5f083-0838-433b-b94d-3d5d37b65797 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:42.429001816 +0000 UTC m=+131.735887807 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs") pod "network-metrics-daemon-d49h2" (UID: "49f5f083-0838-433b-b94d-3d5d37b65797") : secret "metrics-daemon-secret" not found
Sep 17 17:35:38.519534 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.519508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:38.522571 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.522556    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:35:38.532131 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.532108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9042abd-a685-4928-9802-0a0e4fa84d8f-original-pull-secret\") pod \"global-pull-secret-syncer-lh6dh\" (UID: \"c9042abd-a685-4928-9802-0a0e4fa84d8f\") " pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:38.620771 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.620742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:38.623963 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.623947    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:35:38.634584 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.634563    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:35:38.644489 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.644455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzdx\" (UniqueName: \"kubernetes.io/projected/c5cb440e-3068-46d8-ab56-1b9fb6fff3da-kube-api-access-7mzdx\") pod \"network-check-target-wt72c\" (UID: \"c5cb440e-3068-46d8-ab56-1b9fb6fff3da\") " pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:38.723931 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.723878    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2vf4\""
Sep 17 17:35:38.731384 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.731364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:38.733606 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:38.733592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh6dh"
Sep 17 17:35:39.009996 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:39.009930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lh6dh"]
Sep 17 17:35:39.012583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:39.012563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt72c"]
Sep 17 17:35:39.013169 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:35:39.013099    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9042abd_a685_4928_9802_0a0e4fa84d8f.slice/crio-a26e15412c5320e7d505e93a1775fb55e718de4e8b61531a7a813382cb92eab1 WatchSource:0}: Error finding container a26e15412c5320e7d505e93a1775fb55e718de4e8b61531a7a813382cb92eab1: Status 404 returned error can't find the container with id a26e15412c5320e7d505e93a1775fb55e718de4e8b61531a7a813382cb92eab1
Sep 17 17:35:39.015470 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:35:39.015451    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cb440e_3068_46d8_ab56_1b9fb6fff3da.slice/crio-4346a37440c6616a0d4979293a7c3b0b542ffb740973dc688ca107b7886467d6 WatchSource:0}: Error finding container 4346a37440c6616a0d4979293a7c3b0b542ffb740973dc688ca107b7886467d6: Status 404 returned error can't find the container with id 4346a37440c6616a0d4979293a7c3b0b542ffb740973dc688ca107b7886467d6
Sep 17 17:35:39.091169 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:39.091148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt72c" event={"ID":"c5cb440e-3068-46d8-ab56-1b9fb6fff3da","Type":"ContainerStarted","Data":"4346a37440c6616a0d4979293a7c3b0b542ffb740973dc688ca107b7886467d6"}
Sep 17 17:35:39.092215 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:39.092198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lh6dh" event={"ID":"c9042abd-a685-4928-9802-0a0e4fa84d8f","Type":"ContainerStarted","Data":"a26e15412c5320e7d505e93a1775fb55e718de4e8b61531a7a813382cb92eab1"}
Sep 17 17:35:44.111767 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:44.111737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt72c" event={"ID":"c5cb440e-3068-46d8-ab56-1b9fb6fff3da","Type":"ContainerStarted","Data":"2addb66d55c170c5659d7c436cfe42a866804b772193f7de0c6d11f78caad3fe"}
Sep 17 17:35:44.112170 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:44.111845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:35:44.113147 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:44.113127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lh6dh" event={"ID":"c9042abd-a685-4928-9802-0a0e4fa84d8f","Type":"ContainerStarted","Data":"d5d32d501805f066fc4f2c819432add653a6f6b84f8532be71139f4532c25b5c"}
Sep 17 17:35:44.133640 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:44.133599    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wt72c" podStartSLOduration=67.966970292 podStartE2EDuration="1m12.133587745s" totalImagesPullingTime="4.166617453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:44.131970321 +0000 UTC m=+73.438856333" watchObservedRunningTime="2026-09-17 17:35:44.133587745 +0000 UTC m=+73.440473751"
Sep 17 17:35:48.500063 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:48.500030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:35:50.010157 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:35:50.010125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:10.115922 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:10.115890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:36:10.116261 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:10.115999    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:36:10.116261 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:10.116051    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls podName:0e8d3677-ee10-4607-be7c-930124be8e52 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:14.116037728 +0000 UTC m=+163.422923719 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls") pod "dns-default-22ktf" (UID: "0e8d3677-ee10-4607-be7c-930124be8e52") : secret "dns-default-metrics-tls" not found
Sep 17 17:36:12.934093 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:12.934056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:13.033160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:13.033130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:15.117354 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.117327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wt72c"
Sep 17 17:36:15.135937 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.135893    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lh6dh" podStartSLOduration=97.963242743 podStartE2EDuration="1m42.135879909s" totalImagesPullingTime="4.172637166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:44.160464096 +0000 UTC m=+73.467350110" watchObservedRunningTime="2026-09-17 17:36:15.135879909 +0000 UTC m=+104.442765921"
Sep 17 17:36:15.389949 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.389877    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:15.474043 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.474013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:15.599237 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.599212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:15.613713 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.613688    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r24vk"]
Sep 17 17:36:15.638941 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.638922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r24vk"]
Sep 17 17:36:15.639031 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.639018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.643295 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.643253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 17:36:15.643579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.643566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtzf6\""
Sep 17 17:36:15.643862 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.643847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 17:36:15.644123 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.644097    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 17:36:15.644818 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.644800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 17:36:15.650645 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.650627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6680fe-a226-4440-b29c-5f2959f7199f-data-volume\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.650723 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.650651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.650723 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.650668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2fj\" (UniqueName: \"kubernetes.io/projected/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-api-access-lr2fj\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.650723 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.650687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6680fe-a226-4440-b29c-5f2959f7199f-crio-socket\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.650873 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.650815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.690944 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.690910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:15.751426 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751543 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6680fe-a226-4440-b29c-5f2959f7199f-data-volume\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751543 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751543 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2fj\" (UniqueName: \"kubernetes.io/projected/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-api-access-lr2fj\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751543 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:15.751530    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:15.751749 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:15.751582    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:16.251567695 +0000 UTC m=+105.558453706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:15.751749 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6680fe-a226-4440-b29c-5f2959f7199f-crio-socket\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751749 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:15.751583    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:15.751749 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6680fe-a226-4440-b29c-5f2959f7199f-crio-socket\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.751749 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:15.751697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:16.251678169 +0000 UTC m=+105.558564160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:15.751925 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.751768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6680fe-a226-4440-b29c-5f2959f7199f-data-volume\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:15.763603 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:15.763578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2fj\" (UniqueName: \"kubernetes.io/projected/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-api-access-lr2fj\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:16.254698 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:16.254666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:16.255080 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:16.254715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:16.255080 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:16.254787    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:16.255080 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:16.254811    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:16.255080 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:16.254860    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:17.254844478 +0000 UTC m=+106.561730481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:16.255080 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:16.254895    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:17.254873064 +0000 UTC m=+106.561759058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:17.110796 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.110761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:17.261568 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.261536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:17.261954 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.261579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:17.261954 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:17.261666    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:17.261954 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:17.261671    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:17.261954 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:17.261728    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.261712421 +0000 UTC m=+108.568598426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:17.261954 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:17.261742    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.261734923 +0000 UTC m=+108.568620914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:17.264046 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.264020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:17.448244 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.448159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:17.540757 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.540732    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dqxrl_d046e3fc-29d6-405e-a0d2-5d6419a5a71e/dns-node-resolver/0.log"
Sep 17 17:36:17.704706 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.704634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:17.807238 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.807212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:17.943271 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:17.943248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:18.012296 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:18.012241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:18.342389 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:18.342371    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6smjf_a36a4e87-d8e8-4814-a87f-da58c1c478e9/node-ca/0.log"
Sep 17 17:36:18.496946 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:18.496920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:18.621286 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:18.621214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:19.275836 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:19.275807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:19.275977 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:19.275852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:19.275977 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:19.275917    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:19.275977 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:19.275939    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:19.275977 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:19.275972    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.275957224 +0000 UTC m=+112.582843216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:19.276110 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:19.275985    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.275979106 +0000 UTC m=+112.582865097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:19.334198 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:19.334170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j7hfk_0ef46462-a0b3-46ed-a772-01f4d6fa5771/serve-healthcheck-canary/0.log"
Sep 17 17:36:19.577178 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:19.577149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:19.640922 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:19.640901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:20.112801 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:20.112772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:20.217569 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:20.217537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:21.179056 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:21.179015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:23.303909 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.303877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:23.304328 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.303923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:23.304328 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:23.303985    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.304328 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:23.304043    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:31.304027191 +0000 UTC m=+120.610913186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.304328 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:23.304042    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:23.304328 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:23.304105    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:31.304088969 +0000 UTC m=+120.610974980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:23.380045 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.380015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:23.474026 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.473998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:23.585963 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.585883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:23.695049 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.695015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:23.855659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:23.855597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:24.073340 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:24.073312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:25.266028 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:25.265998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:25.467379 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:25.467352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:25.566718 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:25.566692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:25.665514 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:25.665467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:25.875012 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:25.874958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:26.062099 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:26.062068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:26.957831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:26.957801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.060951 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.060923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.256997 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.256926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.461693 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.461673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.667238 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.667208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.758752 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.758730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:27.910783 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:27.910750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:28.015705 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:28.015638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:28.259445 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:28.259423    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:28.782537 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:28.782503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:28.928114 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:28.928087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:29.465295 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:29.465263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:29.662561 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:29.662535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:29.853763 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:29.853739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:30.062256 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:30.062224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:30.260117 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:30.260047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:30.879550 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:30.879517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:31.067160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:31.067112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:31.362681 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:31.362644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:31.362681 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:31.362697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:31.362882 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:31.362787    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:31.362882 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:36:31.362838    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls podName:6f6680fe-a226-4440-b29c-5f2959f7199f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:47.362825318 +0000 UTC m=+136.669711309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r24vk" (UID: "6f6680fe-a226-4440-b29c-5f2959f7199f") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:31.363222 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:31.363205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6680fe-a226-4440-b29c-5f2959f7199f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:31.463029 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:31.462986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:32.268816 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:32.268791    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:32.675767 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:32.675737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:32.857774 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:32.857739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:32.931314 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:32.931247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:33.055752 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:33.055733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:33.268787 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:33.268726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:33.859389 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:33.859361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:34.067294 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:34.067265    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:38.517307 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:38.517277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:38.652953 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:38.652926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:42.239671 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.239629    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" podUID="9005c12c-3a61-47f0-b5a6-380eb3bdf735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 17:36:42.440879 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.440846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:36:42.443221 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.443189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f5f083-0838-433b-b94d-3d5d37b65797-metrics-certs\") pod \"network-metrics-daemon-d49h2\" (UID: \"49f5f083-0838-433b-b94d-3d5d37b65797\") " pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:36:42.630425 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.630400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xc26q\""
Sep 17 17:36:42.637853 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.637834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d49h2"
Sep 17 17:36:42.904236 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:42.904174    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d49h2"]
Sep 17 17:36:42.907141 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:36:42.907117    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f5f083_0838_433b_b94d_3d5d37b65797.slice/crio-abc1a6f530a06361ed7b09ffc166f1e1d4e620ab41e8cb8b4ec27be5bc42fb59 WatchSource:0}: Error finding container abc1a6f530a06361ed7b09ffc166f1e1d4e620ab41e8cb8b4ec27be5bc42fb59: Status 404 returned error can't find the container with id abc1a6f530a06361ed7b09ffc166f1e1d4e620ab41e8cb8b4ec27be5bc42fb59
Sep 17 17:36:43.272336 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:43.272280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d49h2" event={"ID":"49f5f083-0838-433b-b94d-3d5d37b65797","Type":"ContainerStarted","Data":"abc1a6f530a06361ed7b09ffc166f1e1d4e620ab41e8cb8b4ec27be5bc42fb59"}
Sep 17 17:36:44.276636 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:44.276555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d49h2" event={"ID":"49f5f083-0838-433b-b94d-3d5d37b65797","Type":"ContainerStarted","Data":"1adb58088294d0a7404d5cc851323e529e501dedd68f63faad9387ea10c8ee60"}
Sep 17 17:36:44.276934 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:44.276636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d49h2" event={"ID":"49f5f083-0838-433b-b94d-3d5d37b65797","Type":"ContainerStarted","Data":"6635448d2384ccf2df0fba58c2676867bc2a481309459f74894d0c157cb83caf"}
Sep 17 17:36:44.304384 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:44.304339    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d49h2" podStartSLOduration=131.389924045 podStartE2EDuration="2m12.30432379s" totalImagesPullingTime="914.399745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:44.303230663 +0000 UTC m=+133.610116676" watchObservedRunningTime="2026-09-17 17:36:44.30432379 +0000 UTC m=+133.611209803"
Sep 17 17:36:44.455410 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:44.455362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:44.558018 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:44.557992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:46.490659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:46.490622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:46.549387 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:46.549359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:46.987306 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:46.987275    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:47.099609 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.099574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:47.269581 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.269523    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:47.373576 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.373551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:47.375933 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.375910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6680fe-a226-4440-b29c-5f2959f7199f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r24vk\" (UID: \"6f6680fe-a226-4440-b29c-5f2959f7199f\") " pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:47.450348 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.450326    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtzf6\""
Sep 17 17:36:47.457884 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.457866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r24vk"
Sep 17 17:36:47.479731 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.479707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:47.726946 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:47.726922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r24vk"]
Sep 17 17:36:47.729869 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:36:47.729840    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6680fe_a226_4440_b29c_5f2959f7199f.slice/crio-793c8b280133e4d2497b82b41e41804e954a27f2e41c1c3e2360c718ba55e117 WatchSource:0}: Error finding container 793c8b280133e4d2497b82b41e41804e954a27f2e41c1c3e2360c718ba55e117: Status 404 returned error can't find the container with id 793c8b280133e4d2497b82b41e41804e954a27f2e41c1c3e2360c718ba55e117
Sep 17 17:36:48.291444 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:48.291405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r24vk" event={"ID":"6f6680fe-a226-4440-b29c-5f2959f7199f","Type":"ContainerStarted","Data":"e7b8738004340f40dd32719983c7e252721d2845037ff4440715185705cc78f1"}
Sep 17 17:36:48.291611 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:48.291490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r24vk" event={"ID":"6f6680fe-a226-4440-b29c-5f2959f7199f","Type":"ContainerStarted","Data":"793c8b280133e4d2497b82b41e41804e954a27f2e41c1c3e2360c718ba55e117"}
Sep 17 17:36:49.299631 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:49.299592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r24vk" event={"ID":"6f6680fe-a226-4440-b29c-5f2959f7199f","Type":"ContainerStarted","Data":"a3af66f59ef68ba57500c876e5b197f6dfbfb56cca856c43c2c23e0c4a7ff1c4"}
Sep 17 17:36:50.276496 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:50.276452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:50.304570 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:50.304541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r24vk" event={"ID":"6f6680fe-a226-4440-b29c-5f2959f7199f","Type":"ContainerStarted","Data":"3888d9814b8bb0eb24c636e4b7eed04c02b7d50bf0049e03ff76a7e0520635c5"}
Sep 17 17:36:50.328531 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:50.328473    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r24vk" podStartSLOduration=33.554823238 podStartE2EDuration="35.328460216s" totalImagesPullingTime="1.773636978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:36:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:50.327203237 +0000 UTC m=+139.634089250" watchObservedRunningTime="2026-09-17 17:36:50.328460216 +0000 UTC m=+139.635346239"
Sep 17 17:36:50.366911 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:50.366886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:50.481718 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:50.481680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:52.239656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:52.239621    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" podUID="9005c12c-3a61-47f0-b5a6-380eb3bdf735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 17:36:52.411693 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:52.411663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.431603 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.431569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.622266 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.622236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.698171 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.698115    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"]
Sep 17 17:36:54.700511 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.700493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.700809 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.700689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.703656 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.703631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 17:36:54.703756 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.703723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4gxgz\""
Sep 17 17:36:54.704829 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.704811    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 17:36:54.705023 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.705007    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 17:36:54.705102 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.705055    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 17:36:54.705102 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.705062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 17:36:54.711982 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.711962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"]
Sep 17 17:36:54.723867 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.723843    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-84tj7"]
Sep 17 17:36:54.725789 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.725774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.728363 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.728345    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 17:36:54.728453 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.728382    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4zqpp\""
Sep 17 17:36:54.728583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.728569    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 17:36:54.728628 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.728603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 17:36:54.781120 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.781092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.822427 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-tls\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822531 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822531 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058fa105-9147-40a9-ac5a-b0c22512c095-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.822531 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-root\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822531 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-wtmp\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghq6\" (UniqueName: \"kubernetes.io/projected/058fa105-9147-40a9-ac5a-b0c22512c095-kube-api-access-8ghq6\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-textfile\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v694j\" (UniqueName: \"kubernetes.io/projected/b506015f-d2ef-4842-9f60-8d0bde028bd9-kube-api-access-v694j\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.822897 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-sys\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.822897 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.822788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-metrics-client-ca\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.882026 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.882007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:54.923391 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-wtmp\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923391 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghq6\" (UniqueName: \"kubernetes.io/projected/058fa105-9147-40a9-ac5a-b0c22512c095-kube-api-access-8ghq6\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-textfile\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v694j\" (UniqueName: \"kubernetes.io/projected/b506015f-d2ef-4842-9f60-8d0bde028bd9-kube-api-access-v694j\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-sys\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923577 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-metrics-client-ca\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-tls\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-wtmp\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058fa105-9147-40a9-ac5a-b0c22512c095-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-root\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.923865 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-root\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.924197 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-textfile\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.924197 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.923939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b506015f-d2ef-4842-9f60-8d0bde028bd9-sys\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.924303 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.924274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.924419 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.924368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/058fa105-9147-40a9-ac5a-b0c22512c095-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.924549 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.924418    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b506015f-d2ef-4842-9f60-8d0bde028bd9-metrics-client-ca\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.926285 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.926261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.926524 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.926505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-tls\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.926583 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.926565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/058fa105-9147-40a9-ac5a-b0c22512c095-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.926697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.926679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b506015f-d2ef-4842-9f60-8d0bde028bd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.935625 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.935605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghq6\" (UniqueName: \"kubernetes.io/projected/058fa105-9147-40a9-ac5a-b0c22512c095-kube-api-access-8ghq6\") pod \"openshift-state-metrics-86c5bc79d6-d24p5\" (UID: \"058fa105-9147-40a9-ac5a-b0c22512c095\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:54.935737 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.935622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v694j\" (UniqueName: \"kubernetes.io/projected/b506015f-d2ef-4842-9f60-8d0bde028bd9-kube-api-access-v694j\") pod \"node-exporter-84tj7\" (UID: \"b506015f-d2ef-4842-9f60-8d0bde028bd9\") " pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:54.982791 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:54.982723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:55.008657 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.008634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"
Sep 17 17:36:55.034366 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.034341    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-84tj7"
Sep 17 17:36:55.044328 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:36:55.044299    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb506015f_d2ef_4842_9f60_8d0bde028bd9.slice/crio-7c4501e8d9be9d73f0e60473c2ce36bfd9ac1773c139d2863fbe139dbcf0095b WatchSource:0}: Error finding container 7c4501e8d9be9d73f0e60473c2ce36bfd9ac1773c139d2863fbe139dbcf0095b: Status 404 returned error can't find the container with id 7c4501e8d9be9d73f0e60473c2ce36bfd9ac1773c139d2863fbe139dbcf0095b
Sep 17 17:36:55.169896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.169856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:55.286402 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.286377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5"]
Sep 17 17:36:55.288443 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:36:55.288418    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058fa105_9147_40a9_ac5a_b0c22512c095.slice/crio-c99ebe4ab564c0b64ed06a87860c48125b692946347ca8724b8fb5cfa613bb8e WatchSource:0}: Error finding container c99ebe4ab564c0b64ed06a87860c48125b692946347ca8724b8fb5cfa613bb8e: Status 404 returned error can't find the container with id c99ebe4ab564c0b64ed06a87860c48125b692946347ca8724b8fb5cfa613bb8e
Sep 17 17:36:55.293684 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.293653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:55.319946 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.319903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5" event={"ID":"058fa105-9147-40a9-ac5a-b0c22512c095","Type":"ContainerStarted","Data":"c99ebe4ab564c0b64ed06a87860c48125b692946347ca8724b8fb5cfa613bb8e"}
Sep 17 17:36:55.321165 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.321136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84tj7" event={"ID":"b506015f-d2ef-4842-9f60-8d0bde028bd9","Type":"ContainerStarted","Data":"7c4501e8d9be9d73f0e60473c2ce36bfd9ac1773c139d2863fbe139dbcf0095b"}
Sep 17 17:36:55.772053 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.771963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:55.882151 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:55.882119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:56.089769 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:56.089731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:56.326047 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:56.326015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5" event={"ID":"058fa105-9147-40a9-ac5a-b0c22512c095","Type":"ContainerStarted","Data":"aa6e10baa734c62996871eeef03be1df5cbef61988ba921caefb27617f0a8eaf"}
Sep 17 17:36:56.326214 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:56.326069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5" event={"ID":"058fa105-9147-40a9-ac5a-b0c22512c095","Type":"ContainerStarted","Data":"367bafd3fe61436ba659548c36f388b178518b824464ea26065f80e0a8264311"}
Sep 17 17:36:56.327594 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:56.327571    2581 generic.go:356] "Generic (PLEG): container finished" podID="b506015f-d2ef-4842-9f60-8d0bde028bd9" containerID="54d25090b6827d868a4e4a8a560dc24e6b902846722c45ffcdc2268c7c79c6ed" exitCode=0
Sep 17 17:36:56.327683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:56.327606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84tj7" event={"ID":"b506015f-d2ef-4842-9f60-8d0bde028bd9","Type":"ContainerDied","Data":"54d25090b6827d868a4e4a8a560dc24e6b902846722c45ffcdc2268c7c79c6ed"}
Sep 17 17:36:57.333288 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.333247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5" event={"ID":"058fa105-9147-40a9-ac5a-b0c22512c095","Type":"ContainerStarted","Data":"9c30cb94f575f23899edc0203296daf2e9bc83bff898b888422bf85ad98c334b"}
Sep 17 17:36:57.335169 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.335146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84tj7" event={"ID":"b506015f-d2ef-4842-9f60-8d0bde028bd9","Type":"ContainerStarted","Data":"4197a34f99c53405c2ae553401987ebda1d2a0f7987037bb160425cda42f4430"}
Sep 17 17:36:57.335278 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.335192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-84tj7" event={"ID":"b506015f-d2ef-4842-9f60-8d0bde028bd9","Type":"ContainerStarted","Data":"80c7f1704050f583dbf228a2c35136b397a360899172edc84ee3859a2aaf5605"}
Sep 17 17:36:57.353513 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.353448    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-d24p5" podStartSLOduration=2.118501982 podStartE2EDuration="3.353434235s" totalImagesPullingTime="1.234932253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:57.352162558 +0000 UTC m=+146.659048571" watchObservedRunningTime="2026-09-17 17:36:57.353434235 +0000 UTC m=+146.660320247"
Sep 17 17:36:57.372922 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.372884    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-84tj7" podStartSLOduration=2.379936672 podStartE2EDuration="3.372872922s" totalImagesPullingTime="925.162754ms" totalInitContainerRuntime="67.773496ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:57.371781976 +0000 UTC m=+146.678667988" watchObservedRunningTime="2026-09-17 17:36:57.372872922 +0000 UTC m=+146.679758935"
Sep 17 17:36:57.774389 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.774304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:57.869458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.869430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:57.969895 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:57.969865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:59.459725 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:59.459690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:59.559870 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:59.559845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:59.657749 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:59.657715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:36:59.722610 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:36:59.722540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:01.073840 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:01.073809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:02.239827 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.239785    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" podUID="9005c12c-3a61-47f0-b5a6-380eb3bdf735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 17:37:02.240250 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.239857    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5"
Sep 17 17:37:02.240429 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.240390    2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5d9207e5eddfedf05ff14e44a4caf396eaa0715530426cd7a46e4836a8129636"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 17 17:37:02.240518 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.240458    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" podUID="9005c12c-3a61-47f0-b5a6-380eb3bdf735" containerName="service-proxy" containerID="cri-o://5d9207e5eddfedf05ff14e44a4caf396eaa0715530426cd7a46e4836a8129636" gracePeriod=30
Sep 17 17:37:02.354998 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.354971    2581 generic.go:356] "Generic (PLEG): container finished" podID="9005c12c-3a61-47f0-b5a6-380eb3bdf735" containerID="5d9207e5eddfedf05ff14e44a4caf396eaa0715530426cd7a46e4836a8129636" exitCode=2
Sep 17 17:37:02.355078 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:02.355035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerDied","Data":"5d9207e5eddfedf05ff14e44a4caf396eaa0715530426cd7a46e4836a8129636"}
Sep 17 17:37:03.360267 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:03.360222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f9f784bc4-frvn5" event={"ID":"9005c12c-3a61-47f0-b5a6-380eb3bdf735","Type":"ContainerStarted","Data":"4a6939acd6c0a05849798d17615e56b7da8e6f9409d7dd4177c524123f6f8fb9"}
Sep 17 17:37:08.816892 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:08.816856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:08.913032 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:08.913001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.071105 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.071043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.175667 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:37:09.175641    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-22ktf" podUID="0e8d3677-ee10-4607-be7c-930124be8e52"
Sep 17 17:37:09.249538 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.249511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.377704 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.377659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:09.449062 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.449040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.549364 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.549332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.681005 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.680951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:09.844238 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:09.844214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:10.040408 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:10.040379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:10.350767 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:10.350708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:10.493657 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:10.493631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:10.607885 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:10.607823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:11.505726 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:11.505693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:11.594129 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:11.594071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:14.144873 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:14.144842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:14.147132 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:14.147114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0e8d3677-ee10-4607-be7c-930124be8e52-metrics-tls\") pod \"dns-default-22ktf\" (UID: \"0e8d3677-ee10-4607-be7c-930124be8e52\") " pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:14.181211 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:14.181190    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gbrs5\""
Sep 17 17:37:14.188596 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:14.188579    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:14.496169 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:14.496105    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22ktf"]
Sep 17 17:37:14.499260 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:37:14.499231    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8d3677_ee10_4607_be7c_930124be8e52.slice/crio-d0854647dbf52eec362397af62604d2be69a838998fe7e91c80f7d44b5a2eba0 WatchSource:0}: Error finding container d0854647dbf52eec362397af62604d2be69a838998fe7e91c80f7d44b5a2eba0: Status 404 returned error can't find the container with id d0854647dbf52eec362397af62604d2be69a838998fe7e91c80f7d44b5a2eba0
Sep 17 17:37:15.398382 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:15.398347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22ktf" event={"ID":"0e8d3677-ee10-4607-be7c-930124be8e52","Type":"ContainerStarted","Data":"d0854647dbf52eec362397af62604d2be69a838998fe7e91c80f7d44b5a2eba0"}
Sep 17 17:37:16.204374 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:16.204336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:16.348104 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:16.348071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:17.406392 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:17.406351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22ktf" event={"ID":"0e8d3677-ee10-4607-be7c-930124be8e52","Type":"ContainerStarted","Data":"6bb23f5940be22b9ca55227d53d8458b18c85d699740524211ee3c26861ce2f2"}
Sep 17 17:37:17.406792 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:17.406444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22ktf" event={"ID":"0e8d3677-ee10-4607-be7c-930124be8e52","Type":"ContainerStarted","Data":"428a467cb8f5142f8f7b1507df1e8cbb7d082c9273f546c8b5662f8bed12d88c"}
Sep 17 17:37:17.406792 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:17.406493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:17.434311 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:17.434264    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-22ktf" podStartSLOduration=129.579496273 podStartE2EDuration="2m11.434249469s" totalImagesPullingTime="1.854753196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:17.434031372 +0000 UTC m=+166.740917399" watchObservedRunningTime="2026-09-17 17:37:17.434249469 +0000 UTC m=+166.741135481"
Sep 17 17:37:18.040418 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:18.040385    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" podUID="c5aa941d-ec3a-4f40-b2b0-c19d607ae73c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Sep 17 17:37:18.411218 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:18.411188    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5aa941d-ec3a-4f40-b2b0-c19d607ae73c" containerID="861e063f6883ede9485e4236675dd87aa4bebb5ad8669310b926c7a87ba79abc" exitCode=1
Sep 17 17:37:18.411580 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:18.411261    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" event={"ID":"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c","Type":"ContainerDied","Data":"861e063f6883ede9485e4236675dd87aa4bebb5ad8669310b926c7a87ba79abc"}
Sep 17 17:37:18.411647 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:18.411626    2581 scope.go:117] "RemoveContainer" containerID="861e063f6883ede9485e4236675dd87aa4bebb5ad8669310b926c7a87ba79abc"
Sep 17 17:37:19.416054 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:19.416020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59" event={"ID":"c5aa941d-ec3a-4f40-b2b0-c19d607ae73c","Type":"ContainerStarted","Data":"218c02ab5459dedb778e0d2e4cb4dc9a94ef70b2e40a10ec492ea6922bbf5bd4"}
Sep 17 17:37:19.416447 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:19.416308    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:37:19.416853 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:19.416833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b6756b59f-z6w59"
Sep 17 17:37:20.704619 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:20.704578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:20.802949 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:20.802916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:23.493852 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:23.493818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:23.554500 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:23.554451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:23.697508 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:23.697459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:23.760114 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:23.760045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:26.855246 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:26.855210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:26.926724 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:26.926694    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:27.413721 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:27.413696    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-22ktf"
Sep 17 17:37:27.483796 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:27.483763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:27.604838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:27.604806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:29.871011 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:29.870976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:29.931806 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:29.931779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:31.102692 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:31.102658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:31.195395 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:31.195366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:32.520766 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:32.520737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:32.628758 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:32.628733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:32.729431 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:32.729402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:32.831252 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:32.831221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.393628 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:34.393590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.492982 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:34.492949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:34.989674 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:34.989647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:35.054301 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:35.054273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:35.116642 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:35.116624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:36.587341 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:36.587297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:36.684470 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:36.684442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:37.722142 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:37.722113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:38.533231 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:38.533200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:38.648664 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:38.648634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:40.301072 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:40.301021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:40.390016 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:40.389984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:43.473289 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:43.473259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:43.548902 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:43.548868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:51.781436 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:51.781401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:51.853303 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:51.853273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:51.987663 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:51.987628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:52.057214 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:52.057127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:53.524274 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:53.524231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:37:53.616412 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:37:53.616368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:08.506896 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:08.506857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:08.576220 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:08.576188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:12.884630 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:12.884596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:12.973933 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:12.973903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:14.156627 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:14.156592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:14.457375 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:14.457304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:22.042869 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:22.042820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:22.137636 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:22.137612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:22.238688 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:22.238669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:22.784697 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:22.784665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:22.874152 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:22.874131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:23.511173 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:23.511144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:23.602139 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:23.602119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:30.202768 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:30.202736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:30.301604 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:30.301576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:33.079733 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:33.079703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:33.179925 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:33.179887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:33.246222 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:33.246186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:38.501926 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:38.501891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:38:38.567670 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:38:38.567642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:11.384071 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:11.384030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:11.445705 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:11.445673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:29.452037 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:29.451999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:29.554109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:29.554080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:32.648168 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:32.648141    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:39:32.651047 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:32.651017    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 17:39:32.652083 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:32.652069    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:39:40.224332 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:40.224296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:41.412724 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:41.412692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:41.513237 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:41.513210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:43.703982 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:43.703952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:43.777058 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:43.777030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:43.841872 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:43.841844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:44.432246 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:44.432206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:44.533120 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:44.533091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:53.527721 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:53.527689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:53.626624 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:53.626598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:54.513695 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:54.513655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:54.622590 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:54.622561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:39:54.711001 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:39:54.710970    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:24.155047 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:24.155009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:26.344395 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:26.344356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:42.959810 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:42.959721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:43.033262 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:43.033225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:52.356241 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:52.356201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:52.477985 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:52.477945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:53.992860 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:53.992821    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"]
Sep 17 17:41:53.995832 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:53.995814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.005274 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.005255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-px4z7\""
Sep 17 17:41:54.005542 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.005527    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 17:41:54.005818 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.005801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 17:41:54.007071 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.007057    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 17:41:54.018438 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.018411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"]
Sep 17 17:41:54.030632 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.030608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtf7m\" (UniqueName: \"kubernetes.io/projected/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-kube-api-access-mtf7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.030729 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.030641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.131219 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.131198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtf7m\" (UniqueName: \"kubernetes.io/projected/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-kube-api-access-mtf7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.131310 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.131225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.133612 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.133594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.146833 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.146814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtf7m\" (UniqueName: \"kubernetes.io/projected/67f9b3b5-ee11-4477-a6e6-7d4e05b5a771-kube-api-access-mtf7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-mz6n6\" (UID: \"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.306324 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.306293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:54.588965 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.588902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"]
Sep 17 17:41:54.591989 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:41:54.591965    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f9b3b5_ee11_4477_a6e6_7d4e05b5a771.slice/crio-413f20770e0f958b037326caf7063199d6397b567c745cb3893fab71a076daac WatchSource:0}: Error finding container 413f20770e0f958b037326caf7063199d6397b567c745cb3893fab71a076daac: Status 404 returned error can't find the container with id 413f20770e0f958b037326caf7063199d6397b567c745cb3893fab71a076daac
Sep 17 17:41:54.593769 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:54.593749    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:41:55.279530 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:55.279494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6" event={"ID":"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771","Type":"ContainerStarted","Data":"413f20770e0f958b037326caf7063199d6397b567c745cb3893fab71a076daac"}
Sep 17 17:41:58.162230 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.162197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:58.292667 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.292636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6" event={"ID":"67f9b3b5-ee11-4477-a6e6-7d4e05b5a771","Type":"ContainerStarted","Data":"4be239fad9456c8bd7ced1c2304336d11a815eca43946e8ebf753501496186ea"}
Sep 17 17:41:58.292808 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.292772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:41:58.315433 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.315394    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6" podStartSLOduration=2.181341554 podStartE2EDuration="5.315381275s" totalImagesPullingTime="3.134039721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:58.313134967 +0000 UTC m=+447.620020980" watchObservedRunningTime="2026-09-17 17:41:58.315381275 +0000 UTC m=+447.622267289"
Sep 17 17:41:58.439605 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.439545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-lsdg7"]
Sep 17 17:41:58.442464 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.442433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:58.442613 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.442508    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.445295 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.445267    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 17 17:41:58.445404 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.445294    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-g6smt\""
Sep 17 17:41:58.445404 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.445371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 17 17:41:58.453799 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.453778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-lsdg7"]
Sep 17 17:41:58.463785 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.463766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.463871 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.463795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxnw\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-kube-api-access-qwxnw\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.463871 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.463830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/40ca0392-2956-430d-b533-c3009e1d69a6-cabundle0\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.565091 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.565068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.565197 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.565096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxnw\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-kube-api-access-qwxnw\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.565197 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.565124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/40ca0392-2956-430d-b533-c3009e1d69a6-cabundle0\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.565304 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:41:58.565204    2581 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Sep 17 17:41:58.565304 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:41:58.565222    2581 secret.go:281] references non-existent secret key: ca.crt
Sep 17 17:41:58.565304 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:41:58.565230    2581 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 17 17:41:58.565304 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:41:58.565241    2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-lsdg7: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 17:41:58.565304 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:41:58.565287    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates podName:40ca0392-2956-430d-b533-c3009e1d69a6 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:59.065273827 +0000 UTC m=+448.372159823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates") pod "keda-operator-579c8958f7-lsdg7" (UID: "40ca0392-2956-430d-b533-c3009e1d69a6") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 17:41:58.565764 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.565747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/40ca0392-2956-430d-b533-c3009e1d69a6-cabundle0\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.577046 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.577020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxnw\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-kube-api-access-qwxnw\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:58.709641 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.709565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:58.790464 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.790438    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"]
Sep 17 17:41:58.793682 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.793667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.796278 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.796248    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 17 17:41:58.807689 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.807670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"]
Sep 17 17:41:58.827985 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.827959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:58.866722 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.866702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-certificates\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.866832 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.866748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxd9d\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-kube-api-access-nxd9d\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.866832 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.866774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/377c4eb9-19f2-438b-8191-ad08803e6628-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.931810 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.931783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:58.967313 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.967255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-certificates\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.967393 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.967316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxd9d\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-kube-api-access-nxd9d\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.967393 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.967344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/377c4eb9-19f2-438b-8191-ad08803e6628-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.967772 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.967755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/377c4eb9-19f2-438b-8191-ad08803e6628-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.970109 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.970084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-certificates\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:58.980260 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:58.980241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxd9d\" (UniqueName: \"kubernetes.io/projected/377c4eb9-19f2-438b-8191-ad08803e6628-kube-api-access-nxd9d\") pod \"keda-metrics-apiserver-77857b7b98-fqtzr\" (UID: \"377c4eb9-19f2-438b-8191-ad08803e6628\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:59.020821 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.020797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:59.068061 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.068039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:59.070165 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.070143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/40ca0392-2956-430d-b533-c3009e1d69a6-certificates\") pod \"keda-operator-579c8958f7-lsdg7\" (UID: \"40ca0392-2956-430d-b533-c3009e1d69a6\") " pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:59.104129 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.104106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:41:59.159590 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.159561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:59.352179 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.352149    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:41:59.372128 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.372103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:59.381213 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.381195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"]
Sep 17 17:41:59.383792 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:41:59.383771    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377c4eb9_19f2_438b_8191_ad08803e6628.slice/crio-e0a05283cf7d2e20034388560f1e4e774b9657d05a3130f53f4f0e764ec6db3e WatchSource:0}: Error finding container e0a05283cf7d2e20034388560f1e4e774b9657d05a3130f53f4f0e764ec6db3e: Status 404 returned error can't find the container with id e0a05283cf7d2e20034388560f1e4e774b9657d05a3130f53f4f0e764ec6db3e
Sep 17 17:41:59.573445 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.573410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:59.623720 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.623701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-lsdg7"]
Sep 17 17:41:59.625962 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:41:59.625934    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ca0392_2956_430d_b533_c3009e1d69a6.slice/crio-898d9379860bc1c0717d8f69cec724c9791d99b919a6481685316a1c7d2e236e WatchSource:0}: Error finding container 898d9379860bc1c0717d8f69cec724c9791d99b919a6481685316a1c7d2e236e: Status 404 returned error can't find the container with id 898d9379860bc1c0717d8f69cec724c9791d99b919a6481685316a1c7d2e236e
Sep 17 17:41:59.736452 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.736417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:41:59.831857 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:41:59.831837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:00.302391 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:00.302348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-lsdg7" event={"ID":"40ca0392-2956-430d-b533-c3009e1d69a6","Type":"ContainerStarted","Data":"898d9379860bc1c0717d8f69cec724c9791d99b919a6481685316a1c7d2e236e"}
Sep 17 17:42:00.303760 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:00.303729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr" event={"ID":"377c4eb9-19f2-438b-8191-ad08803e6628","Type":"ContainerStarted","Data":"e0a05283cf7d2e20034388560f1e4e774b9657d05a3130f53f4f0e764ec6db3e"}
Sep 17 17:42:00.406202 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:00.406133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:00.508790 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:00.508728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:03.317094 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.317060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-lsdg7" event={"ID":"40ca0392-2956-430d-b533-c3009e1d69a6","Type":"ContainerStarted","Data":"6f1a588880b14c8cebde2c3844e098243287c7d67721a666bb2a79c2bebfb863"}
Sep 17 17:42:03.317554 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.317193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:42:03.318833 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.318807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr" event={"ID":"377c4eb9-19f2-438b-8191-ad08803e6628","Type":"ContainerStarted","Data":"6eab76d63f59d37a447b7c5234084c594f622dfd9a6f28da4fd034a77dd85159"}
Sep 17 17:42:03.318968 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.318937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:42:03.343032 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.342988    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-lsdg7" podStartSLOduration=1.992263342 podStartE2EDuration="5.342975758s" totalImagesPullingTime="3.350712416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:03.342663927 +0000 UTC m=+452.649549956" watchObservedRunningTime="2026-09-17 17:42:03.342975758 +0000 UTC m=+452.649861771"
Sep 17 17:42:03.371858 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:03.371815    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr" podStartSLOduration=1.784684913 podStartE2EDuration="5.371801633s" totalImagesPullingTime="3.58711672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:03.370745086 +0000 UTC m=+452.677631101" watchObservedRunningTime="2026-09-17 17:42:03.371801633 +0000 UTC m=+452.678687654"
Sep 17 17:42:11.132623 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:11.132464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:11.261994 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:11.261962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:14.327735 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:14.327707    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-fqtzr"
Sep 17 17:42:17.362786 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:17.362746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:19.298610 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:19.298585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-mz6n6"
Sep 17 17:42:24.325911 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:24.325884    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-lsdg7"
Sep 17 17:42:28.151221 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:28.151185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:28.212610 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:28.212565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:28.286069 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:28.286042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:28.353239 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:28.353214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:28.902987 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:28.902956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:29.001997 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:29.001959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:39.120187 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:39.120139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:39.224883 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:39.224849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:39.298996 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:39.298959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:50.895374 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:50.895323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:42:50.961843 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:42:50.961817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:14.628134 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:14.628025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:15.022784 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:15.022708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:32.669107 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:32.669072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:38.332591 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.332544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:38.457652 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.457620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"]
Sep 17 17:43:38.460168 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.460147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.463693 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.463673    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 17:43:38.466102 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.466080    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 17:43:38.466224 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.466088    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 17:43:38.470211 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.470194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-4njz2\""
Sep 17 17:43:38.492003 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.491977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:38.502931 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.502908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"]
Sep 17 17:43:38.615331 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.615253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dskzp\" (UniqueName: \"kubernetes.io/projected/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-kube-api-access-dskzp\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.615331 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.615296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.666178 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.666150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:38.715790 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.715764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dskzp\" (UniqueName: \"kubernetes.io/projected/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-kube-api-access-dskzp\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.715867 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.715798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.715912 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:43:38.715887    2581 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 17:43:38.715952 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:43:38.715945    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert podName:a043a9e1-c1e5-411b-b52f-ecf89272cb3d nodeName:}" failed. No retries permitted until 2026-09-17 17:43:39.215930175 +0000 UTC m=+548.522816167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert") pod "llmisvc-controller-manager-645f9c8fd6-nbs7z" (UID: "a043a9e1-c1e5-411b-b52f-ecf89272cb3d") : secret "llmisvc-webhook-server-cert" not found
Sep 17 17:43:38.733438 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.733410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dskzp\" (UniqueName: \"kubernetes.io/projected/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-kube-api-access-dskzp\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:38.891559 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:38.891466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:39.219661 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.219566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:39.222069 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.222048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a043a9e1-c1e5-411b-b52f-ecf89272cb3d-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nbs7z\" (UID: \"a043a9e1-c1e5-411b-b52f-ecf89272cb3d\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:39.317826 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.317795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:39.370280 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.370257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:39.419838 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.419807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:39.520283 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.520191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:43:39.642628 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.642590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"]
Sep 17 17:43:39.644731 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:43:39.644686    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda043a9e1_c1e5_411b_b52f_ecf89272cb3d.slice/crio-c8c7bd56727fe2948812fd71244d48ce37d9f6259fadd269ce563291f48f0643 WatchSource:0}: Error finding container c8c7bd56727fe2948812fd71244d48ce37d9f6259fadd269ce563291f48f0643: Status 404 returned error can't find the container with id c8c7bd56727fe2948812fd71244d48ce37d9f6259fadd269ce563291f48f0643
Sep 17 17:43:39.662821 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:39.662794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z" event={"ID":"a043a9e1-c1e5-411b-b52f-ecf89272cb3d","Type":"ContainerStarted","Data":"c8c7bd56727fe2948812fd71244d48ce37d9f6259fadd269ce563291f48f0643"}
Sep 17 17:43:42.679665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:42.679628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z" event={"ID":"a043a9e1-c1e5-411b-b52f-ecf89272cb3d","Type":"ContainerStarted","Data":"135e092acc237b28298fd8321956f6a439ee66459ab2a7454de764e59ad6bb50"}
Sep 17 17:43:42.680102 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:42.679757    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:43:42.703021 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:43:42.702976    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z" podStartSLOduration=2.361228632 podStartE2EDuration="4.702964134s" totalImagesPullingTime="2.341735502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:42.700559643 +0000 UTC m=+552.007445658" watchObservedRunningTime="2026-09-17 17:43:42.702964134 +0000 UTC m=+552.009850148"
Sep 17 17:44:13.685516 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:13.685463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nbs7z"
Sep 17 17:44:25.047305 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:25.047271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:32.671909 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:32.671880    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:44:32.673933 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:32.673894    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:44:57.835589 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:57.835543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:57.996665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:57.996633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:58.107021 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:58.106953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:58.241762 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:58.241729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:59.766415 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:59.766381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:44:59.904620 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:44:59.904583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:32.450548 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:32.450444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:33.803386 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:33.803359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:43.200349 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:43.200310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.004874 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.004835    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.168112 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.168081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.280123 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.280085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.288281 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.288259    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:46:45.291377 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.291360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.294719 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.294691    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.294829 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.294719    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"success-200-isvc-4a129-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4a129-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap"
Sep 17 17:46:45.294829 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.294719    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 17 17:46:45.295079 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.295055    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 17 17:46:45.295235 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.295211    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"success-200-isvc-4a129-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4a129-predictor-serving-cert\"" type="*v1.Secret"
Sep 17 17:46:45.295900 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:45.295881    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-r96lh\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-r96lh\"" type="*v1.Secret"
Sep 17 17:46:45.327832 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.327809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:46:45.395783 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.395749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntcrk\" (UniqueName: \"kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.395783 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.395787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.395939 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.395806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.417256 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.417228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.496625 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.496598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.496736 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.496635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.496736 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.496689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntcrk\" (UniqueName: \"kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:45.582038 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.581947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:45.839235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:45.839147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:46.042265 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.042228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:46.386687 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.386657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-r96lh\""
Sep 17 17:46:46.417119 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.417095    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 17:46:46.453416 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.453396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4a129-predictor-serving-cert\""
Sep 17 17:46:46.459668 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.459647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:46.497200 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:46.497175    2581 configmap.go:193] Couldn't get configMap kserve-ci-e2e-test/success-200-isvc-4a129-kube-rbac-proxy-sar-config: failed to sync configmap cache: timed out waiting for the condition
Sep 17 17:46:46.497320 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:46:46.497249    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config podName:ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997 nodeName:}" failed. No retries permitted until 2026-09-17 17:46:46.997233826 +0000 UTC m=+736.304119818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-sar-config" (UniqueName: "kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config") pod "success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" (UID: "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 17:46:46.533635 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.533608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:46:46.718501 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.718423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-4a129-kube-rbac-proxy-sar-config\""
Sep 17 17:46:46.785264 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.785241    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 17:46:46.794579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:46.794553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntcrk\" (UniqueName: \"kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:47.008501 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:47.008403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:47.009023 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:47.009005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") " pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:47.101437 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:47.101406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:46:47.374415 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:47.374387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:46:47.376960 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:46:47.376931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2e2ae3_364f_4f3d_9c1a_0bf5d0003997.slice/crio-2cf1f5ba70bfabc6f42d8174d86ba901e1d6b2219fc1e655fd78fcf0acfde8ec WatchSource:0}: Error finding container 2cf1f5ba70bfabc6f42d8174d86ba901e1d6b2219fc1e655fd78fcf0acfde8ec: Status 404 returned error can't find the container with id 2cf1f5ba70bfabc6f42d8174d86ba901e1d6b2219fc1e655fd78fcf0acfde8ec
Sep 17 17:46:48.312209 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:48.312172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerStarted","Data":"2cf1f5ba70bfabc6f42d8174d86ba901e1d6b2219fc1e655fd78fcf0acfde8ec"}
Sep 17 17:46:58.822381 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:58.822358    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:46:59.368648 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:46:59.368594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerStarted","Data":"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"}
Sep 17 17:47:01.382995 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:01.382960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerStarted","Data":"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"}
Sep 17 17:47:01.383422 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:01.383122    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:47:01.383422 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:01.383166    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:47:01.384650 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:01.384626    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:01.418525 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:01.418464    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podStartSLOduration=2.849331829 podStartE2EDuration="16.418451904s" totalImagesPullingTime="13.569120075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:01.416937738 +0000 UTC m=+750.723823751" watchObservedRunningTime="2026-09-17 17:47:01.418451904 +0000 UTC m=+750.725337918"
Sep 17 17:47:02.386659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:02.386615    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:07.391119 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:07.391084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:47:07.391658 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:07.391629    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:17.391994 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:17.391944    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:27.392377 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:27.392335    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:37.392326 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:37.392282    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:47:47.392621 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:47:47.392546    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:48:05.023328 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:05.023285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:05.136492 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:05.136450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:05.252337 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:05.252297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.213118 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.213076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.353435 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.353401    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:48:15.353675 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.353648    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" containerID="cri-o://f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2" gracePeriod=30
Sep 17 17:48:15.353743 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.353658    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kube-rbac-proxy" containerID="cri-o://41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5" gracePeriod=30
Sep 17 17:48:15.438919 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.438886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.601024 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.600987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.643839 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.643813    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerID="41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5" exitCode=2
Sep 17 17:48:15.643963 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.643844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerDied","Data":"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"}
Sep 17 17:48:15.681334 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.681308    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:48:15.683284 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.683271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.687493 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:15.687450    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.687599 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:15.687467    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"success-200-isvc-8142b-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8142b-predictor-serving-cert\"" type="*v1.Secret"
Sep 17 17:48:15.687599 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:15.687534    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"success-200-isvc-8142b-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8142b-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap"
Sep 17 17:48:15.720211 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.720156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:48:15.754351 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.754328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.837799 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.837770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zj7\" (UniqueName: \"kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.837928 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.837805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.837928 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.837828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.928458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.928425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:15.938597 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.938570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64zj7\" (UniqueName: \"kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.938700 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.938613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.938700 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.938644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:15.952622 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:15.952603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zj7\" (UniqueName: \"kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:16.062121 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:16.062095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:48:16.626247 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:16.626209    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8142b-predictor-serving-cert\""
Sep 17 17:48:16.631297 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:16.631276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:16.939537 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:16.939438    2581 configmap.go:193] Couldn't get configMap kserve-ci-e2e-test/success-200-isvc-8142b-kube-rbac-proxy-sar-config: failed to sync configmap cache: timed out waiting for the condition
Sep 17 17:48:16.939671 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:16.939541    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config podName:4eddbee5-3338-417f-9760-0edcb73635b7 nodeName:}" failed. No retries permitted until 2026-09-17 17:48:17.439524739 +0000 UTC m=+826.746410732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-sar-config" (UniqueName: "kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config") pod "success-200-isvc-8142b-predictor-79bffc4977-htq8k" (UID: "4eddbee5-3338-417f-9760-0edcb73635b7") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 17:48:17.236974 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.236894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8142b-kube-rbac-proxy-sar-config\""
Sep 17 17:48:17.387426 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.387388    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.16:8643/healthz\": dial tcp 10.133.0.16:8643: connect: connection refused"
Sep 17 17:48:17.391681 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.391657    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.16:8080: connect: connection refused"
Sep 17 17:48:17.449603 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.449570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:17.450208 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.450187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8142b-predictor-79bffc4977-htq8k\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") " pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:17.492458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.492380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:17.778341 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.778316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:48:17.779236 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:48:17.779213    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eddbee5_3338_417f_9760_0edcb73635b7.slice/crio-83b9191c1f74239eb38f93cc8a6e72bb7af3691a9810ae3c995041ad20bb3428 WatchSource:0}: Error finding container 83b9191c1f74239eb38f93cc8a6e72bb7af3691a9810ae3c995041ad20bb3428: Status 404 returned error can't find the container with id 83b9191c1f74239eb38f93cc8a6e72bb7af3691a9810ae3c995041ad20bb3428
Sep 17 17:48:17.992126 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:17.992106    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:48:18.154000 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.153973    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntcrk\" (UniqueName: \"kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk\") pod \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") "
Sep 17 17:48:18.154157 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.154011    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") pod \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") "
Sep 17 17:48:18.154157 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.154056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls\") pod \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\" (UID: \"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997\") "
Sep 17 17:48:18.154427 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.154398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" (UID: "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:48:18.156255 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.156234    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk" (OuterVolumeSpecName: "kube-api-access-ntcrk") pod "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" (UID: "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997"). InnerVolumeSpecName "kube-api-access-ntcrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:48:18.156255 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.156241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" (UID: "ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:48:18.255432 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.255408    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntcrk\" (UniqueName: \"kubernetes.io/projected/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-api-access-ntcrk\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:48:18.255432 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.255429    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:48:18.255586 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.255438    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:48:18.656132 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.656100    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerID="f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2" exitCode=0
Sep 17 17:48:18.656309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.656155    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"
Sep 17 17:48:18.656309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.656177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerDied","Data":"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"}
Sep 17 17:48:18.656309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.656270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w" event={"ID":"ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997","Type":"ContainerDied","Data":"2cf1f5ba70bfabc6f42d8174d86ba901e1d6b2219fc1e655fd78fcf0acfde8ec"}
Sep 17 17:48:18.656309 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.656305    2581 scope.go:117] "RemoveContainer" containerID="41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"
Sep 17 17:48:18.658185 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.658154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerStarted","Data":"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"}
Sep 17 17:48:18.658298 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.658219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerStarted","Data":"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"}
Sep 17 17:48:18.658298 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.658254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerStarted","Data":"83b9191c1f74239eb38f93cc8a6e72bb7af3691a9810ae3c995041ad20bb3428"}
Sep 17 17:48:18.658298 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.658293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:18.658437 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.658325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:18.659886 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.659854    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:48:18.664953 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.664936    2581 scope.go:117] "RemoveContainer" containerID="f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"
Sep 17 17:48:18.672135 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.672107    2581 scope.go:117] "RemoveContainer" containerID="41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"
Sep 17 17:48:18.672401 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:18.672384    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5\": container with ID starting with 41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5 not found: ID does not exist" containerID="41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"
Sep 17 17:48:18.672460 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.672411    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5"} err="failed to get container status \"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5\": rpc error: code = NotFound desc = could not find container \"41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5\": container with ID starting with 41b5377dc1e18b3eb57db370ded8b3730aed64ac2e9e24e6efe89f72216733e5 not found: ID does not exist"
Sep 17 17:48:18.672460 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.672427    2581 scope.go:117] "RemoveContainer" containerID="f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"
Sep 17 17:48:18.672672 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:48:18.672655    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2\": container with ID starting with f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2 not found: ID does not exist" containerID="f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"
Sep 17 17:48:18.672725 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.672681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2"} err="failed to get container status \"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2\": rpc error: code = NotFound desc = could not find container \"f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2\": container with ID starting with f8d34be3906ce98eb0b3863c82381907b322b863d8c016e47f9af65e9fd981c2 not found: ID does not exist"
Sep 17 17:48:18.728397 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.728358    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podStartSLOduration=3.728346214 podStartE2EDuration="3.728346214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:48:18.69795817 +0000 UTC m=+828.004844184" watchObservedRunningTime="2026-09-17 17:48:18.728346214 +0000 UTC m=+828.035232257"
Sep 17 17:48:18.728528 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.728503    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:48:18.736780 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.736759    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-4a129-predictor-5c488f9bbf-ljp4w"]
Sep 17 17:48:18.806590 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:18.806565    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" path="/var/lib/kubelet/pods/ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997/volumes"
Sep 17 17:48:19.662927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:19.662886    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:48:24.666878 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:24.666851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:48:24.667281 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:24.667255    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:48:34.667353 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:34.667314    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:48:44.667599 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:44.667556    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:48:54.668094 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:48:54.668046    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.17:8080: connect: connection refused"
Sep 17 17:49:04.668665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:04.668631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:49:05.004880 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:05.004797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:05.114143 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:05.114107    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:15.504753 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:15.504670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:15.667596 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:15.667558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:15.831686 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:15.831661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:15.984683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:15.984646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:16.176333 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176250    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:49:16.176616 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176603    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container"
Sep 17 17:49:16.176665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176619    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container"
Sep 17 17:49:16.176665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176635    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kube-rbac-proxy"
Sep 17 17:49:16.176665 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176640    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kube-rbac-proxy"
Sep 17 17:49:16.176757 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176689    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kserve-container"
Sep 17 17:49:16.176757 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.176698    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2e2ae3-364f-4f3d-9c1a-0bf5d0003997" containerName="kube-rbac-proxy"
Sep 17 17:49:16.179702 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.179687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.189556 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.189535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-dcaf3-kube-rbac-proxy-sar-config\""
Sep 17 17:49:16.190965 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.190948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-dcaf3-predictor-serving-cert\""
Sep 17 17:49:16.241023 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.240989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:16.252064 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.252034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.252173 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.252080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.252173 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.252096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t62lt\" (UniqueName: \"kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.284732 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.284703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:49:16.353136 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.353105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.353136 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.353135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t62lt\" (UniqueName: \"kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.353310 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.353278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.353969 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.353910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.355588 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.355567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.367187 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.367162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t62lt\" (UniqueName: \"kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt\") pod \"success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") " pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.489039 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.488987    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:16.503644 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.503617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:16.751617 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.751527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:49:16.775777 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.775756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:49:16.777740 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:49:16.777702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7ac24a_084e_4e74_8dcb_6700b25de8c2.slice/crio-0830422daa40e85e05ce7f1171e5d9196415c106d5a436dbe2b0089c67c23692 WatchSource:0}: Error finding container 0830422daa40e85e05ce7f1171e5d9196415c106d5a436dbe2b0089c67c23692: Status 404 returned error can't find the container with id 0830422daa40e85e05ce7f1171e5d9196415c106d5a436dbe2b0089c67c23692
Sep 17 17:49:16.868891 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.868869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerStarted","Data":"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"}
Sep 17 17:49:16.868974 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:16.868920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerStarted","Data":"0830422daa40e85e05ce7f1171e5d9196415c106d5a436dbe2b0089c67c23692"}
Sep 17 17:49:17.877020 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:17.876983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerStarted","Data":"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"}
Sep 17 17:49:17.877384 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:17.877042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:17.877384 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:17.877085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:17.878553 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:17.878533    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:49:17.906314 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:17.906263    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podStartSLOduration=1.9062489390000001 podStartE2EDuration="1.906248939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:17.902979795 +0000 UTC m=+887.209865809" watchObservedRunningTime="2026-09-17 17:49:17.906248939 +0000 UTC m=+887.213134952"
Sep 17 17:49:18.881576 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:18.881536    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:49:23.886318 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:23.886289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:49:23.886776 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:23.886752    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:49:32.696060 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:32.696033    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:49:32.696571 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:32.696190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:49:33.887494 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:33.887444    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:49:43.887142 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:43.887100    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:49:53.887385 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:49:53.887343    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 17:50:03.887694 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:50:03.887654    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:50:13.374535 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:50:13.374444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:16.021675 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:50:16.021642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:50:16.180831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:50:16.180798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:51:56.642161 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:51:56.642118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:53:01.729694 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:53:01.729657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:54:32.719872 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:54:32.719845    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:54:32.720509 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:54:32.720469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:57:12.465869 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:12.465839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:29.988617 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:29.988572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.175706 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.175671    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:57:30.175975 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.175945    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kube-rbac-proxy" containerID="cri-o://7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f" gracePeriod=30
Sep 17 17:57:30.176082 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.175945    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container" containerID="cri-o://37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797" gracePeriod=30
Sep 17 17:57:30.220255 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.220215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.309253 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.309221    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:57:30.312690 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.312672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.318774 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.318746    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1fda1-predictor-serving-cert\""
Sep 17 17:57:30.318918 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.318747    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1fda1-kube-rbac-proxy-sar-config\""
Sep 17 17:57:30.329618 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.329587    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:57:30.338134 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.338098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.431956 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.431924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.469054 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.469027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.469218 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.469082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.469218 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.469118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.533314 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.533280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.570462 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.570382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.570462 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.570431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.570659 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.570510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.571108 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.571086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.573106 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.573081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.583681 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.583642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7\") pod \"success-200-isvc-1fda1-predictor-67c979686f-cnskz\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") " pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.623969 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.623921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:30.720798 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.720765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:30.759819 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.759783    2581 generic.go:356] "Generic (PLEG): container finished" podID="4eddbee5-3338-417f-9760-0edcb73635b7" containerID="7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f" exitCode=2
Sep 17 17:57:30.759982 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.759836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerDied","Data":"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"}
Sep 17 17:57:30.899725 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:30.899698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:57:30.902407 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:57:30.902379    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fbdf638_41bf_4afe_b858_caeb6259a8bf.slice/crio-64d663670e5e799cbd849a2a424444f9cd21760adf74aad88c490923f3c51d02 WatchSource:0}: Error finding container 64d663670e5e799cbd849a2a424444f9cd21760adf74aad88c490923f3c51d02: Status 404 returned error can't find the container with id 64d663670e5e799cbd849a2a424444f9cd21760adf74aad88c490923f3c51d02
Sep 17 17:57:31.765022 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.764980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerStarted","Data":"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"}
Sep 17 17:57:31.765420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.765064    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:31.765420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.765190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:31.765420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.765241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerStarted","Data":"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"}
Sep 17 17:57:31.765420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.765280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerStarted","Data":"64d663670e5e799cbd849a2a424444f9cd21760adf74aad88c490923f3c51d02"}
Sep 17 17:57:31.766420 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.766395    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:57:31.792063 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:31.792018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podStartSLOduration=1.792006025 podStartE2EDuration="1.792006025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:31.790602569 +0000 UTC m=+1381.097488582" watchObservedRunningTime="2026-09-17 17:57:31.792006025 +0000 UTC m=+1381.098892038"
Sep 17 17:57:32.769407 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:32.769361    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:57:33.923623 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.923598    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:57:33.995458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.995371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") pod \"4eddbee5-3338-417f-9760-0edcb73635b7\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") "
Sep 17 17:57:33.995458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.995415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls\") pod \"4eddbee5-3338-417f-9760-0edcb73635b7\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") "
Sep 17 17:57:33.995458 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.995449    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64zj7\" (UniqueName: \"kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7\") pod \"4eddbee5-3338-417f-9760-0edcb73635b7\" (UID: \"4eddbee5-3338-417f-9760-0edcb73635b7\") "
Sep 17 17:57:33.995797 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.995771    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4eddbee5-3338-417f-9760-0edcb73635b7" (UID: "4eddbee5-3338-417f-9760-0edcb73635b7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:33.997751 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.997725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7" (OuterVolumeSpecName: "kube-api-access-64zj7") pod "4eddbee5-3338-417f-9760-0edcb73635b7" (UID: "4eddbee5-3338-417f-9760-0edcb73635b7"). InnerVolumeSpecName "kube-api-access-64zj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:33.997874 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:33.997816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4eddbee5-3338-417f-9760-0edcb73635b7" (UID: "4eddbee5-3338-417f-9760-0edcb73635b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:34.096891 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.096853    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eddbee5-3338-417f-9760-0edcb73635b7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.096891 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.096882    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eddbee5-3338-417f-9760-0edcb73635b7-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.096891 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.096893    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64zj7\" (UniqueName: \"kubernetes.io/projected/4eddbee5-3338-417f-9760-0edcb73635b7-kube-api-access-64zj7\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:57:34.777916 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.777884    2581 generic.go:356] "Generic (PLEG): container finished" podID="4eddbee5-3338-417f-9760-0edcb73635b7" containerID="37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797" exitCode=0
Sep 17 17:57:34.778090 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.777947    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"
Sep 17 17:57:34.778090 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.777964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerDied","Data":"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"}
Sep 17 17:57:34.778090 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.778023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k" event={"ID":"4eddbee5-3338-417f-9760-0edcb73635b7","Type":"ContainerDied","Data":"83b9191c1f74239eb38f93cc8a6e72bb7af3691a9810ae3c995041ad20bb3428"}
Sep 17 17:57:34.778090 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.778052    2581 scope.go:117] "RemoveContainer" containerID="7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"
Sep 17 17:57:34.787046 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.787014    2581 scope.go:117] "RemoveContainer" containerID="37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"
Sep 17 17:57:34.794668 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.794517    2581 scope.go:117] "RemoveContainer" containerID="7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"
Sep 17 17:57:34.794787 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:57:34.794771    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f\": container with ID starting with 7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f not found: ID does not exist" containerID="7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"
Sep 17 17:57:34.794823 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.794797    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f"} err="failed to get container status \"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f\": rpc error: code = NotFound desc = could not find container \"7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f\": container with ID starting with 7a7cad1dbfbff729e120f56d54f09e41ae668b6084146faa9b75ba4f13889d0f not found: ID does not exist"
Sep 17 17:57:34.794823 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.794813    2581 scope.go:117] "RemoveContainer" containerID="37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"
Sep 17 17:57:34.795051 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:57:34.795036    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797\": container with ID starting with 37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797 not found: ID does not exist" containerID="37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"
Sep 17 17:57:34.795090 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.795056    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797"} err="failed to get container status \"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797\": rpc error: code = NotFound desc = could not find container \"37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797\": container with ID starting with 37cf1a542f8bde3477f5dcfe60e644f53873aa473a923a2749953a0d6280b797 not found: ID does not exist"
Sep 17 17:57:34.808349 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.808327    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:57:34.818028 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:34.818000    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8142b-predictor-79bffc4977-htq8k"]
Sep 17 17:57:36.807106 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:36.807069    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" path="/var/lib/kubelet/pods/4eddbee5-3338-417f-9760-0edcb73635b7/volumes"
Sep 17 17:57:37.773862 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:37.773832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:57:37.774335 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:37.774306    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:57:47.774443 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:47.774400    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:57:54.234850 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:54.234810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:55.519325 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:55.519285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:57.774600 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:57:57.774562    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:58:07.775011 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:07.774970    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.19:8080: connect: connection refused"
Sep 17 17:58:17.775579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:17.775542    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:58:30.339769 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.339733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:30.702160 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.702082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:30.808548 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.808506    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:58:30.808721 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.808701    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container" containerID="cri-o://3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803" gracePeriod=30
Sep 17 17:58:30.808780 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.808716    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kube-rbac-proxy" containerID="cri-o://72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927" gracePeriod=30
Sep 17 17:58:30.815159 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.815138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:30.922846 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.922817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:30.953594 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:58:30.953811 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953798    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kube-rbac-proxy"
Sep 17 17:58:30.953811 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953811    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kube-rbac-proxy"
Sep 17 17:58:30.953927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953820    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container"
Sep 17 17:58:30.953927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953827    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container"
Sep 17 17:58:30.953927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953875    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kube-rbac-proxy"
Sep 17 17:58:30.953927 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.953886    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eddbee5-3338-417f-9760-0edcb73635b7" containerName="kserve-container"
Sep 17 17:58:30.956669 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.956652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:30.962598 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.962579    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c397f-predictor-serving-cert\""
Sep 17 17:58:30.963270 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.963251    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-c397f-kube-rbac-proxy-sar-config\""
Sep 17 17:58:30.980769 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:30.978754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:58:31.006908 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.006884    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerID="72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927" exitCode=2
Sep 17 17:58:31.006987 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.006959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerDied","Data":"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"}
Sep 17 17:58:31.031500 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.031461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.097687 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.097654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqg6j\" (UniqueName: \"kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.097821 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.097745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.097821 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.097806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.154545 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.154520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.198555 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.198522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.198683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.198559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.198683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.198582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqg6j\" (UniqueName: \"kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.199172 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.199152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.201261 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.201243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.217021 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.216961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqg6j\" (UniqueName: \"kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j\") pod \"success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") " pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.266162 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.266134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:31.332245 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.332219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.557164 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:31.557137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:58:31.560147 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:58:31.560120    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f34ccf_548c_4096_b47c_ff1d35bbb964.slice/crio-2c9358e5d68d0e702539e34f711d2c13a9d777b7ec44305723cadd1f6bd25e88 WatchSource:0}: Error finding container 2c9358e5d68d0e702539e34f711d2c13a9d777b7ec44305723cadd1f6bd25e88: Status 404 returned error can't find the container with id 2c9358e5d68d0e702539e34f711d2c13a9d777b7ec44305723cadd1f6bd25e88
Sep 17 17:58:32.012934 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.012860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerStarted","Data":"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"}
Sep 17 17:58:32.012934 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.012925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:32.013144 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.012947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerStarted","Data":"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"}
Sep 17 17:58:32.013144 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.012972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:32.013144 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.012993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerStarted","Data":"2c9358e5d68d0e702539e34f711d2c13a9d777b7ec44305723cadd1f6bd25e88"}
Sep 17 17:58:32.014272 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.014249    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:58:32.045115 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:32.045070    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podStartSLOduration=2.045055432 podStartE2EDuration="2.045055432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:32.042932513 +0000 UTC m=+1441.349818529" watchObservedRunningTime="2026-09-17 17:58:32.045055432 +0000 UTC m=+1441.351941446"
Sep 17 17:58:33.015976 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.015883    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:58:33.849654 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.849630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:58:33.926254 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.926188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config\") pod \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") "
Sep 17 17:58:33.926254 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.926246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t62lt\" (UniqueName: \"kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt\") pod \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") "
Sep 17 17:58:33.926406 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.926304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls\") pod \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\" (UID: \"8c7ac24a-084e-4e74-8dcb-6700b25de8c2\") "
Sep 17 17:58:33.926575 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.926551    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8c7ac24a-084e-4e74-8dcb-6700b25de8c2" (UID: "8c7ac24a-084e-4e74-8dcb-6700b25de8c2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:33.929100 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.929070    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt" (OuterVolumeSpecName: "kube-api-access-t62lt") pod "8c7ac24a-084e-4e74-8dcb-6700b25de8c2" (UID: "8c7ac24a-084e-4e74-8dcb-6700b25de8c2"). InnerVolumeSpecName "kube-api-access-t62lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:33.929100 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:33.929092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8c7ac24a-084e-4e74-8dcb-6700b25de8c2" (UID: "8c7ac24a-084e-4e74-8dcb-6700b25de8c2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:34.021766 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.021732    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerID="3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803" exitCode=0
Sep 17 17:58:34.022128 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.021781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"
Sep 17 17:58:34.022128 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.021796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerDied","Data":"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"}
Sep 17 17:58:34.022128 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.021859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25" event={"ID":"8c7ac24a-084e-4e74-8dcb-6700b25de8c2","Type":"ContainerDied","Data":"0830422daa40e85e05ce7f1171e5d9196415c106d5a436dbe2b0089c67c23692"}
Sep 17 17:58:34.022128 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.021886    2581 scope.go:117] "RemoveContainer" containerID="72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"
Sep 17 17:58:34.026816 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.026795    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:34.026906 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.026823    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:34.026906 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.026839    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t62lt\" (UniqueName: \"kubernetes.io/projected/8c7ac24a-084e-4e74-8dcb-6700b25de8c2-kube-api-access-t62lt\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:34.030344 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.030318    2581 scope.go:117] "RemoveContainer" containerID="3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"
Sep 17 17:58:34.037579 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.037556    2581 scope.go:117] "RemoveContainer" containerID="72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"
Sep 17 17:58:34.037854 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:34.037834    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927\": container with ID starting with 72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927 not found: ID does not exist" containerID="72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"
Sep 17 17:58:34.037917 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.037861    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927"} err="failed to get container status \"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927\": rpc error: code = NotFound desc = could not find container \"72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927\": container with ID starting with 72fa8581eb111e68c9f866fb5fd5de9ea3450703ae9c467b30c638a7b024d927 not found: ID does not exist"
Sep 17 17:58:34.037917 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.037878    2581 scope.go:117] "RemoveContainer" containerID="3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"
Sep 17 17:58:34.038123 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:34.038109    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803\": container with ID starting with 3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803 not found: ID does not exist" containerID="3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"
Sep 17 17:58:34.038162 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.038126    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803"} err="failed to get container status \"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803\": rpc error: code = NotFound desc = could not find container \"3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803\": container with ID starting with 3cbf94caaa2826fa6ba04c1caf816ded1db382eb479d3f14cfecdfc82eb7e803 not found: ID does not exist"
Sep 17 17:58:34.053530 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.053509    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:58:34.058601 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.058581    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-dcaf3-predictor-5b5b4dfc-f5n25"]
Sep 17 17:58:34.806641 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:34.806610    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" path="/var/lib/kubelet/pods/8c7ac24a-084e-4e74-8dcb-6700b25de8c2/volumes"
Sep 17 17:58:38.020800 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:38.020771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:58:38.021349 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:38.021202    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:58:44.564167 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.564136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.667726 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.667692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:58:44.667940 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.667914    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container" containerID="cri-o://5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e" gracePeriod=30
Sep 17 17:58:44.667985 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.667936    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kube-rbac-proxy" containerID="cri-o://51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e" gracePeriod=30
Sep 17 17:58:44.746358 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.746330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.884009 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.883930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.906143 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906119    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 17:58:44.906416 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906404    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kube-rbac-proxy"
Sep 17 17:58:44.906468 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906417    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kube-rbac-proxy"
Sep 17 17:58:44.906468 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906428    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container"
Sep 17 17:58:44.906468 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906434    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container"
Sep 17 17:58:44.906604 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906496    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kube-rbac-proxy"
Sep 17 17:58:44.906604 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.906506    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7ac24a-084e-4e74-8dcb-6700b25de8c2" containerName="kserve-container"
Sep 17 17:58:44.909346 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.909331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:44.914611 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.914592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1175d-predictor-serving-cert\""
Sep 17 17:58:44.920395 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.920378    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1175d-kube-rbac-proxy-sar-config\""
Sep 17 17:58:44.930118 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:44.930027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 17:58:45.004804 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.004774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.004933 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.004826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.004933 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.004870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgrm\" (UniqueName: \"kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.043462 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.043428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.063224 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.063196    2581 generic.go:356] "Generic (PLEG): container finished" podID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerID="51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e" exitCode=2
Sep 17 17:58:45.063323 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.063266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerDied","Data":"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"}
Sep 17 17:58:45.105723 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.105698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.105820 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.105732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgrm\" (UniqueName: \"kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.105820 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.105755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.105914 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:45.105857    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-1175d-predictor-serving-cert: secret "success-200-isvc-1175d-predictor-serving-cert" not found
Sep 17 17:58:45.105914 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:45.105913    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls podName:b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f nodeName:}" failed. No retries permitted until 2026-09-17 17:58:45.605895294 +0000 UTC m=+1454.912781285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls") pod "success-200-isvc-1175d-predictor-c88c69555-c5nkn" (UID: "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f") : secret "success-200-isvc-1175d-predictor-serving-cert" not found
Sep 17 17:58:45.106387 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.106368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.123606 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.123579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgrm\" (UniqueName: \"kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.203235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.203186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:45.609437 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.609409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:45.609799 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:45.609549    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-1175d-predictor-serving-cert: secret "success-200-isvc-1175d-predictor-serving-cert" not found
Sep 17 17:58:45.609799 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:45.609602    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls podName:b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f nodeName:}" failed. No retries permitted until 2026-09-17 17:58:46.609588328 +0000 UTC m=+1455.916474319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls") pod "success-200-isvc-1175d-predictor-c88c69555-c5nkn" (UID: "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f") : secret "success-200-isvc-1175d-predictor-serving-cert" not found
Sep 17 17:58:45.782964 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:45.782929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:46.615877 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:46.615834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:46.618411 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:46.618387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"success-200-isvc-1175d-predictor-c88c69555-c5nkn\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") " pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:46.720176 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:46.720140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:46.998916 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:46.998837    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 17:58:47.001891 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:58:47.001857    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18e7f31_fd64_41dd_b4e4_a8d2542b7d9f.slice/crio-495107da7a45322518f11c8b8e3333cad1be3d30f6445499d718ebfb1144ee15 WatchSource:0}: Error finding container 495107da7a45322518f11c8b8e3333cad1be3d30f6445499d718ebfb1144ee15: Status 404 returned error can't find the container with id 495107da7a45322518f11c8b8e3333cad1be3d30f6445499d718ebfb1144ee15
Sep 17 17:58:47.073211 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.073128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerStarted","Data":"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"}
Sep 17 17:58:47.073211 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.073199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerStarted","Data":"495107da7a45322518f11c8b8e3333cad1be3d30f6445499d718ebfb1144ee15"}
Sep 17 17:58:47.419089 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.419060    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:58:47.524750 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.524714    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls\") pod \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") "
Sep 17 17:58:47.524909 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.524775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7\") pod \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") "
Sep 17 17:58:47.524909 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.524824    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config\") pod \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\" (UID: \"5fbdf638-41bf-4afe-b858-caeb6259a8bf\") "
Sep 17 17:58:47.525255 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.525220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5fbdf638-41bf-4afe-b858-caeb6259a8bf" (UID: "5fbdf638-41bf-4afe-b858-caeb6259a8bf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:47.526892 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.526865    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7" (OuterVolumeSpecName: "kube-api-access-jkdn7") pod "5fbdf638-41bf-4afe-b858-caeb6259a8bf" (UID: "5fbdf638-41bf-4afe-b858-caeb6259a8bf"). InnerVolumeSpecName "kube-api-access-jkdn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:47.526989 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.526965    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5fbdf638-41bf-4afe-b858-caeb6259a8bf" (UID: "5fbdf638-41bf-4afe-b858-caeb6259a8bf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:47.626191 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.626165    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-api-access-jkdn7\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:47.626191 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.626193    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5fbdf638-41bf-4afe-b858-caeb6259a8bf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:47.626549 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:47.626204    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5fbdf638-41bf-4afe-b858-caeb6259a8bf-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:58:48.021645 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.021558    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:58:48.079785 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.079750    2581 generic.go:356] "Generic (PLEG): container finished" podID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerID="5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e" exitCode=0
Sep 17 17:58:48.079961 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.079804    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"
Sep 17 17:58:48.079961 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.079845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerDied","Data":"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"}
Sep 17 17:58:48.079961 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.079925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz" event={"ID":"5fbdf638-41bf-4afe-b858-caeb6259a8bf","Type":"ContainerDied","Data":"64d663670e5e799cbd849a2a424444f9cd21760adf74aad88c490923f3c51d02"}
Sep 17 17:58:48.080135 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.079962    2581 scope.go:117] "RemoveContainer" containerID="51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"
Sep 17 17:58:48.082423 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.082398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerStarted","Data":"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"}
Sep 17 17:58:48.082576 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.082463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:48.090711 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.090696    2581 scope.go:117] "RemoveContainer" containerID="5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"
Sep 17 17:58:48.097855 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.097840    2581 scope.go:117] "RemoveContainer" containerID="51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"
Sep 17 17:58:48.098139 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:48.098120    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e\": container with ID starting with 51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e not found: ID does not exist" containerID="51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"
Sep 17 17:58:48.098195 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.098147    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e"} err="failed to get container status \"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e\": rpc error: code = NotFound desc = could not find container \"51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e\": container with ID starting with 51d6381d1fc689d5f25d395df88d2a9e9d752c158672a8d7ab6d3df59d2c8f7e not found: ID does not exist"
Sep 17 17:58:48.098195 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.098164    2581 scope.go:117] "RemoveContainer" containerID="5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"
Sep 17 17:58:48.098399 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:58:48.098380    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e\": container with ID starting with 5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e not found: ID does not exist" containerID="5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"
Sep 17 17:58:48.098440 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.098406    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e"} err="failed to get container status \"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e\": rpc error: code = NotFound desc = could not find container \"5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e\": container with ID starting with 5683009d2f697388eeb59294d562877d8e10409bf63fea97e195d879afdcb40e not found: ID does not exist"
Sep 17 17:58:48.117275 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.117227    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podStartSLOduration=4.117210063 podStartE2EDuration="4.117210063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:48.115511446 +0000 UTC m=+1457.422397463" watchObservedRunningTime="2026-09-17 17:58:48.117210063 +0000 UTC m=+1457.424096080"
Sep 17 17:58:48.144846 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.144825    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:58:48.151663 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.151639    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fda1-predictor-67c979686f-cnskz"]
Sep 17 17:58:48.807347 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:48.807305    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" path="/var/lib/kubelet/pods/5fbdf638-41bf-4afe-b858-caeb6259a8bf/volumes"
Sep 17 17:58:49.088417 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:49.088339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:49.089700 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:49.089671    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:58:50.092469 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:50.092426    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:58:55.098135 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:55.098105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:58:55.098529 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:55.098504    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:58:58.021752 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:58:58.021714    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:59:05.098830 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:05.098788    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:59:08.022214 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:08.022167    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.20:8080: connect: connection refused"
Sep 17 17:59:15.099119 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:15.099080    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:59:18.022125 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:18.022096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:59:25.098630 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:25.098587    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Sep 17 17:59:30.814080 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:30.814047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:30.985828 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:30.985798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:32.742101 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:32.742064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:59:32.744616 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:32.744597    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 17:59:35.099890 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:35.099859    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 17:59:40.892386 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:40.892347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:40.993694 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:40.993658    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:59:40.993987 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:40.993955    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container" containerID="cri-o://93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640" gracePeriod=30
Sep 17 17:59:40.993987 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:40.993955    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kube-rbac-proxy" containerID="cri-o://5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477" gracePeriod=30
Sep 17 17:59:41.039349 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.039324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:41.122235 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.122215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:41.137412 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137387    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 17:59:41.137736 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137722    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kube-rbac-proxy"
Sep 17 17:59:41.137831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137738    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kube-rbac-proxy"
Sep 17 17:59:41.137831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137751    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container"
Sep 17 17:59:41.137831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137757    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container"
Sep 17 17:59:41.137831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137801    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kube-rbac-proxy"
Sep 17 17:59:41.137831 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.137809    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fbdf638-41bf-4afe-b858-caeb6259a8bf" containerName="kserve-container"
Sep 17 17:59:41.140674 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.140660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.143239 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.143192    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1e4e7-predictor-serving-cert\""
Sep 17 17:59:41.143323 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.143250    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1e4e7-kube-rbac-proxy-sar-config\""
Sep 17 17:59:41.152664 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.152645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 17:59:41.185283 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.185258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mgr4\" (UniqueName: \"kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.185371 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.185298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.185371 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.185331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.225553 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.225514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:41.285889 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.285865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.285993 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.285911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mgr4\" (UniqueName: \"kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.285993 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.285936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.286466 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.286447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.288624 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.288602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.292585 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.292563    2581 generic.go:356] "Generic (PLEG): container finished" podID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerID="5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477" exitCode=2
Sep 17 17:59:41.292663 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.292595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerDied","Data":"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"}
Sep 17 17:59:41.297661 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.297643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mgr4\" (UniqueName: \"kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4\") pod \"success-200-isvc-1e4e7-predictor-76564f499-76j8q\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") " pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.322794 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.322768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:41.450114 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.450046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:41.554053 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.554025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:41.738526 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:41.738408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 17:59:41.741512 ip-10-0-134-158 kubenswrapper[2581]: W0917 17:59:41.741466    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d333de_924f_4d2e_a6b7_ac3f05b5fcc1.slice/crio-3317847704b0de1c792e501417d3cd8859e0631387e109d3a2f99f2c75aa55af WatchSource:0}: Error finding container 3317847704b0de1c792e501417d3cd8859e0631387e109d3a2f99f2c75aa55af: Status 404 returned error can't find the container with id 3317847704b0de1c792e501417d3cd8859e0631387e109d3a2f99f2c75aa55af
Sep 17 17:59:42.297773 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.297737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerStarted","Data":"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"}
Sep 17 17:59:42.298163 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.297800    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:42.298163 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.297824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerStarted","Data":"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"}
Sep 17 17:59:42.298163 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.297853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:42.298163 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.297879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerStarted","Data":"3317847704b0de1c792e501417d3cd8859e0631387e109d3a2f99f2c75aa55af"}
Sep 17 17:59:42.299171 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.299146    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 17:59:42.320033 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:42.319978    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podStartSLOduration=1.319956854 podStartE2EDuration="1.319956854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:59:42.318217666 +0000 UTC m=+1511.625103680" watchObservedRunningTime="2026-09-17 17:59:42.319956854 +0000 UTC m=+1511.626842868"
Sep 17 17:59:43.016638 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.016590    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.20:8643/healthz\": dial tcp 10.133.0.20:8643: connect: connection refused"
Sep 17 17:59:43.301492 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.301449    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 17:59:43.837444 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.837419    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:59:43.905828 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.905758    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls\") pod \"48f34ccf-548c-4096-b47c-ff1d35bbb964\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") "
Sep 17 17:59:43.905828 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.905811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqg6j\" (UniqueName: \"kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j\") pod \"48f34ccf-548c-4096-b47c-ff1d35bbb964\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") "
Sep 17 17:59:43.905828 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.905828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config\") pod \"48f34ccf-548c-4096-b47c-ff1d35bbb964\" (UID: \"48f34ccf-548c-4096-b47c-ff1d35bbb964\") "
Sep 17 17:59:43.906167 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.906149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "48f34ccf-548c-4096-b47c-ff1d35bbb964" (UID: "48f34ccf-548c-4096-b47c-ff1d35bbb964"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:43.907941 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.907922    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "48f34ccf-548c-4096-b47c-ff1d35bbb964" (UID: "48f34ccf-548c-4096-b47c-ff1d35bbb964"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:43.908052 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:43.908031    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j" (OuterVolumeSpecName: "kube-api-access-dqg6j") pod "48f34ccf-548c-4096-b47c-ff1d35bbb964" (UID: "48f34ccf-548c-4096-b47c-ff1d35bbb964"). InnerVolumeSpecName "kube-api-access-dqg6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:44.006338 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.006314    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/48f34ccf-548c-4096-b47c-ff1d35bbb964-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:59:44.006338 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.006335    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqg6j\" (UniqueName: \"kubernetes.io/projected/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-api-access-dqg6j\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:59:44.006508 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.006345    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/48f34ccf-548c-4096-b47c-ff1d35bbb964-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 17:59:44.306284 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.306253    2581 generic.go:356] "Generic (PLEG): container finished" podID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerID="93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640" exitCode=0
Sep 17 17:59:44.306683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.306298    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"
Sep 17 17:59:44.306683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.306335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerDied","Data":"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"}
Sep 17 17:59:44.306683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.306391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9" event={"ID":"48f34ccf-548c-4096-b47c-ff1d35bbb964","Type":"ContainerDied","Data":"2c9358e5d68d0e702539e34f711d2c13a9d777b7ec44305723cadd1f6bd25e88"}
Sep 17 17:59:44.306683 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.306418    2581 scope.go:117] "RemoveContainer" containerID="5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"
Sep 17 17:59:44.320317 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.320297    2581 scope.go:117] "RemoveContainer" containerID="93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"
Sep 17 17:59:44.327794 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.327776    2581 scope.go:117] "RemoveContainer" containerID="5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"
Sep 17 17:59:44.328054 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:59:44.328035    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477\": container with ID starting with 5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477 not found: ID does not exist" containerID="5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"
Sep 17 17:59:44.328117 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.328061    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477"} err="failed to get container status \"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477\": rpc error: code = NotFound desc = could not find container \"5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477\": container with ID starting with 5cc4425cc22df49f4a7d254f19f3609ee254b3c0746400ca264521f9003f5477 not found: ID does not exist"
Sep 17 17:59:44.328117 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.328079    2581 scope.go:117] "RemoveContainer" containerID="93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"
Sep 17 17:59:44.328335 ip-10-0-134-158 kubenswrapper[2581]: E0917 17:59:44.328322    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640\": container with ID starting with 93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640 not found: ID does not exist" containerID="93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"
Sep 17 17:59:44.328374 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.328339    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640"} err="failed to get container status \"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640\": rpc error: code = NotFound desc = could not find container \"93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640\": container with ID starting with 93f21f503d85b5c83a4cfa6b1f4e2048fd1a4ae06e3fe2ff64dfd3cf63adf640 not found: ID does not exist"
Sep 17 17:59:44.338222 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.338201    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:59:44.344707 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.344686    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-c397f-predictor-84cc68fd6c-lzhj9"]
Sep 17 17:59:44.807217 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:44.807191    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" path="/var/lib/kubelet/pods/48f34ccf-548c-4096-b47c-ff1d35bbb964/volumes"
Sep 17 17:59:48.307586 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:48.307556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 17:59:48.308093 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:48.308065    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 17:59:54.831994 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:54.831962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:55.103951 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:55.103879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:58.308239 ip-10-0-134-158 kubenswrapper[2581]: I0917 17:59:58.308196    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 18:00:08.308018 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:00:08.307977    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 18:00:18.308025 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:00:18.307979    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 18:00:28.308643 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:00:28.308615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 18:00:42.517893 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:00:42.517854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:42.596831 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:00:42.596798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:50.128632 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:03:50.128598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:02.593830 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:04:02.593796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:32.765586 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:04:32.765551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:04:32.768712 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:04:32.768692    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:08:09.529388 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.529353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.608789 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.608757    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 18:08:09.608995 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.608970    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container" containerID="cri-o://bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6" gracePeriod=30
Sep 17 18:08:09.609084 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.609060    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kube-rbac-proxy" containerID="cri-o://0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2" gracePeriod=30
Sep 17 18:08:09.628593 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.628568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.734145 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.734115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.773744 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.773719    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:08:09.774061 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774049    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kube-rbac-proxy"
Sep 17 18:08:09.774105 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774064    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kube-rbac-proxy"
Sep 17 18:08:09.774105 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774073    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container"
Sep 17 18:08:09.774105 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774078    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container"
Sep 17 18:08:09.774189 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774125    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kserve-container"
Sep 17 18:08:09.774189 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.774135    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f34ccf-548c-4096-b47c-ff1d35bbb964" containerName="kube-rbac-proxy"
Sep 17 18:08:09.777092 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.777075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.780703 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.780653    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9819a-kube-rbac-proxy-sar-config\""
Sep 17 18:08:09.780703 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.780653    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-9819a-predictor-serving-cert\""
Sep 17 18:08:09.788747 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.788726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:08:09.837025 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.837005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.893004 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.892983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78m6\" (UniqueName: \"kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.893118 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.893048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.893118 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.893071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.965547 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.965504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:09.993714 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.993692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78m6\" (UniqueName: \"kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.993801 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.993740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.993801 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.993761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:09.993892 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:09.993849    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-9819a-predictor-serving-cert: secret "success-200-isvc-9819a-predictor-serving-cert" not found
Sep 17 18:08:09.993936 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:09.993920    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls podName:f98ec658-9c1e-44a5-870d-c315c2612a32 nodeName:}" failed. No retries permitted until 2026-09-17 18:08:10.493904946 +0000 UTC m=+2019.800790937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls") pod "success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" (UID: "f98ec658-9c1e-44a5-870d-c315c2612a32") : secret "success-200-isvc-9819a-predictor-serving-cert" not found
Sep 17 18:08:09.994271 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:09.994255    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:10.006408 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.006387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78m6\" (UniqueName: \"kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:10.092789 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.092735    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.21:8643/healthz\": dial tcp 10.133.0.21:8643: connect: connection refused"
Sep 17 18:08:10.124801 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.124773    2581 generic.go:356] "Generic (PLEG): container finished" podID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerID="0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2" exitCode=2
Sep 17 18:08:10.124886 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.124844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerDied","Data":"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"}
Sep 17 18:08:10.220438 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.220411    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:10.498123 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:10.498051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:10.498248 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:10.498154    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-9819a-predictor-serving-cert: secret "success-200-isvc-9819a-predictor-serving-cert" not found
Sep 17 18:08:10.498248 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:10.498206    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls podName:f98ec658-9c1e-44a5-870d-c315c2612a32 nodeName:}" failed. No retries permitted until 2026-09-17 18:08:11.498193284 +0000 UTC m=+2020.805079275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls") pod "success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" (UID: "f98ec658-9c1e-44a5-870d-c315c2612a32") : secret "success-200-isvc-9819a-predictor-serving-cert" not found
Sep 17 18:08:11.177076 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:11.177047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:11.505702 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:11.505627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:11.508225 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:11.508191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") " pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:11.586179 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:11.586151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:11.876712 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:11.876685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:08:11.877164 ip-10-0-134-158 kubenswrapper[2581]: W0917 18:08:11.877143    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98ec658_9c1e_44a5_870d_c315c2612a32.slice/crio-1e3dad3b4cc15963a3919d65e550c66caf19fa1592e6b07bd6f30218187a51ff WatchSource:0}: Error finding container 1e3dad3b4cc15963a3919d65e550c66caf19fa1592e6b07bd6f30218187a51ff: Status 404 returned error can't find the container with id 1e3dad3b4cc15963a3919d65e550c66caf19fa1592e6b07bd6f30218187a51ff
Sep 17 18:08:12.135525 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.135450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerStarted","Data":"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"}
Sep 17 18:08:12.135525 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.135518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerStarted","Data":"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"}
Sep 17 18:08:12.135657 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.135543    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:12.135657 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.135561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerStarted","Data":"1e3dad3b4cc15963a3919d65e550c66caf19fa1592e6b07bd6f30218187a51ff"}
Sep 17 18:08:12.156996 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.156954    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podStartSLOduration=3.156940636 podStartE2EDuration="3.156940636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:08:12.155174 +0000 UTC m=+2021.462060037" watchObservedRunningTime="2026-09-17 18:08:12.156940636 +0000 UTC m=+2021.463826648"
Sep 17 18:08:12.342348 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.342324    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 18:08:12.513742 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.513717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config\") pod \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") "
Sep 17 18:08:12.513895 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.513769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") pod \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") "
Sep 17 18:08:12.513895 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.513799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bgrm\" (UniqueName: \"kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm\") pod \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\" (UID: \"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f\") "
Sep 17 18:08:12.514134 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.514088    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" (UID: "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:08:12.516074 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.516045    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" (UID: "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:08:12.516240 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.516218    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm" (OuterVolumeSpecName: "kube-api-access-4bgrm") pod "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" (UID: "b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f"). InnerVolumeSpecName "kube-api-access-4bgrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:08:12.615115 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.615085    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:12.615115 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.615108    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:12.615115 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:12.615118    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bgrm\" (UniqueName: \"kubernetes.io/projected/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f-kube-api-access-4bgrm\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:13.140600 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.140528    2581 generic.go:356] "Generic (PLEG): container finished" podID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerID="bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6" exitCode=0
Sep 17 18:08:13.140600 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.140579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"
Sep 17 18:08:13.140769 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.140618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerDied","Data":"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"}
Sep 17 18:08:13.140769 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.140673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn" event={"ID":"b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f","Type":"ContainerDied","Data":"495107da7a45322518f11c8b8e3333cad1be3d30f6445499d718ebfb1144ee15"}
Sep 17 18:08:13.140769 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.140700    2581 scope.go:117] "RemoveContainer" containerID="0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"
Sep 17 18:08:13.141120 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.141079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:13.143062 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.143036    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:13.148797 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.148782    2581 scope.go:117] "RemoveContainer" containerID="bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"
Sep 17 18:08:13.156574 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.156561    2581 scope.go:117] "RemoveContainer" containerID="0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"
Sep 17 18:08:13.156829 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:13.156811    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2\": container with ID starting with 0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2 not found: ID does not exist" containerID="0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"
Sep 17 18:08:13.156897 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.156836    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2"} err="failed to get container status \"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2\": rpc error: code = NotFound desc = could not find container \"0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2\": container with ID starting with 0f5348f6ce4e12cede3eb16732bfe16784a0b357248e09ebcbd54538c445f9e2 not found: ID does not exist"
Sep 17 18:08:13.156897 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.156850    2581 scope.go:117] "RemoveContainer" containerID="bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"
Sep 17 18:08:13.157108 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:13.157092    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6\": container with ID starting with bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6 not found: ID does not exist" containerID="bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"
Sep 17 18:08:13.157166 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.157113    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6"} err="failed to get container status \"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6\": rpc error: code = NotFound desc = could not find container \"bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6\": container with ID starting with bb00a417f4772b8442b1eaf00bc42d0c044bdb816146cd929ead38e591afc5e6 not found: ID does not exist"
Sep 17 18:08:13.175781 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.175757    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 18:08:13.192659 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:13.192636    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1175d-predictor-c88c69555-c5nkn"]
Sep 17 18:08:14.145720 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:14.145674    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:14.807257 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:14.807218    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" path="/var/lib/kubelet/pods/b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f/volumes"
Sep 17 18:08:19.150696 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:19.150665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:19.151086 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:19.151037    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:29.152062 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:29.152024    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:39.152083 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:39.152048    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:49.152046 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:49.151967    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 17 18:08:55.873353 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:55.873315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:55.978841 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:55.978812    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 18:08:55.979092 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:55.979066    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" containerID="cri-o://712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536" gracePeriod=30
Sep 17 18:08:55.979201 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:55.979115    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kube-rbac-proxy" containerID="cri-o://eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8" gracePeriod=30
Sep 17 18:08:56.051699 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.051668    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:08:56.052129 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052115    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kube-rbac-proxy"
Sep 17 18:08:56.052173 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052133    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kube-rbac-proxy"
Sep 17 18:08:56.052173 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052167    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container"
Sep 17 18:08:56.052234 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052176    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container"
Sep 17 18:08:56.052266 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052237    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kserve-container"
Sep 17 18:08:56.052266 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.052249    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18e7f31-fd64-41dd-b4e4-a8d2542b7d9f" containerName="kube-rbac-proxy"
Sep 17 18:08:56.055460 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.055442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.059235 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.059216    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5ec4c-predictor-serving-cert\""
Sep 17 18:08:56.059339 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.059235    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5ec4c-kube-rbac-proxy-sar-config\""
Sep 17 18:08:56.067500 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.067453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:08:56.108071 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.108052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5l7d\" (UniqueName: \"kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.108150 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.108085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.108150 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.108144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.208771 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.208698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.208771 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.208751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.208976 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.208786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5l7d\" (UniqueName: \"kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.209387 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.209363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.211190 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.211170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.223845 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.223817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5l7d\" (UniqueName: \"kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d\") pod \"success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") " pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.292319 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.292296    2581 generic.go:356] "Generic (PLEG): container finished" podID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerID="eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8" exitCode=2
Sep 17 18:08:56.292415 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.292372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerDied","Data":"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"}
Sep 17 18:08:56.364829 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.364793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:56.654088 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:56.654059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:08:56.656887 ip-10-0-134-158 kubenswrapper[2581]: W0917 18:08:56.656860    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc174225_a213_4d46_8daa_3fb53fb0c9fb.slice/crio-cf6d057a0c2d66446c5724343f77ef0015e7f5e9990d85931c72c8b0511e7076 WatchSource:0}: Error finding container cf6d057a0c2d66446c5724343f77ef0015e7f5e9990d85931c72c8b0511e7076: Status 404 returned error can't find the container with id cf6d057a0c2d66446c5724343f77ef0015e7f5e9990d85931c72c8b0511e7076
Sep 17 18:08:57.298082 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.298046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerStarted","Data":"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"}
Sep 17 18:08:57.298565 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.298111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerStarted","Data":"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"}
Sep 17 18:08:57.298565 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.298140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerStarted","Data":"cf6d057a0c2d66446c5724343f77ef0015e7f5e9990d85931c72c8b0511e7076"}
Sep 17 18:08:57.298565 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.298192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:57.319381 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.319319    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podStartSLOduration=1.31930364 podStartE2EDuration="1.31930364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:08:57.319130237 +0000 UTC m=+2066.626016251" watchObservedRunningTime="2026-09-17 18:08:57.31930364 +0000 UTC m=+2066.626189655"
Sep 17 18:08:57.392027 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:57.392004    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:58.301724 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:58.301683    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:08:58.302132 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:58.301854    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.22:8643/healthz\": dial tcp 10.133.0.22:8643: connect: connection refused"
Sep 17 18:08:58.303222 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:58.303195    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:08:58.308650 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:58.308629    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 17 18:08:58.930927 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:58.930902    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 18:08:59.030824 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.030796    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls\") pod \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") "
Sep 17 18:08:59.030961 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.030892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config\") pod \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") "
Sep 17 18:08:59.030961 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.030922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mgr4\" (UniqueName: \"kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4\") pod \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\" (UID: \"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1\") "
Sep 17 18:08:59.031240 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.031215    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" (UID: "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:08:59.032909 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.032876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" (UID: "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:08:59.033104 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.033085    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4" (OuterVolumeSpecName: "kube-api-access-4mgr4") pod "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" (UID: "32d333de-924f-4d2e-a6b7-ac3f05b5fcc1"). InnerVolumeSpecName "kube-api-access-4mgr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:08:59.132329 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.132305    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:59.132329 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.132327    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:59.132446 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.132336    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mgr4\" (UniqueName: \"kubernetes.io/projected/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1-kube-api-access-4mgr4\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:08:59.152633 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.152610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:08:59.306910 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.306831    2581 generic.go:356] "Generic (PLEG): container finished" podID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerID="712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536" exitCode=0
Sep 17 18:08:59.306910 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.306875    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"
Sep 17 18:08:59.307344 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.306915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerDied","Data":"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"}
Sep 17 18:08:59.307344 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.306968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q" event={"ID":"32d333de-924f-4d2e-a6b7-ac3f05b5fcc1","Type":"ContainerDied","Data":"3317847704b0de1c792e501417d3cd8859e0631387e109d3a2f99f2c75aa55af"}
Sep 17 18:08:59.307344 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.306995    2581 scope.go:117] "RemoveContainer" containerID="eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"
Sep 17 18:08:59.307525 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.307395    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:08:59.315501 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.315463    2581 scope.go:117] "RemoveContainer" containerID="712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"
Sep 17 18:08:59.322871 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.322851    2581 scope.go:117] "RemoveContainer" containerID="eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"
Sep 17 18:08:59.323141 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:59.323118    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8\": container with ID starting with eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8 not found: ID does not exist" containerID="eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"
Sep 17 18:08:59.323184 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.323155    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8"} err="failed to get container status \"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8\": rpc error: code = NotFound desc = could not find container \"eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8\": container with ID starting with eff01bfb4c321b1b06f4901a7e1697b6ea2990d4c591b50917e23184af8176c8 not found: ID does not exist"
Sep 17 18:08:59.323184 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.323178    2581 scope.go:117] "RemoveContainer" containerID="712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"
Sep 17 18:08:59.323453 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:08:59.323435    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536\": container with ID starting with 712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536 not found: ID does not exist" containerID="712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"
Sep 17 18:08:59.323555 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.323459    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536"} err="failed to get container status \"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536\": rpc error: code = NotFound desc = could not find container \"712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536\": container with ID starting with 712b3d6fe5cd6c6b2499f7548d476af2dc9a11c817a94b4ac8db90364f6b6536 not found: ID does not exist"
Sep 17 18:08:59.339865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.337004    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 18:08:59.346440 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:08:59.346417    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1e4e7-predictor-76564f499-76j8q"]
Sep 17 18:09:00.807194 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:00.807158    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" path="/var/lib/kubelet/pods/32d333de-924f-4d2e-a6b7-ac3f05b5fcc1/volumes"
Sep 17 18:09:04.311654 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:04.311621    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:09:04.312232 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:04.312205    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:09:09.722007 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:09.721968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:09.945765 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:09.945703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:14.312992 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:14.312950    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:09:19.821050 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:19.821016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:19.956161 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:19.956125    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:09:19.956465 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:19.956434    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container" containerID="cri-o://937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88" gracePeriod=30
Sep 17 18:09:19.956565 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:19.956505    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kube-rbac-proxy" containerID="cri-o://ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b" gracePeriod=30
Sep 17 18:09:20.162392 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.162365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:20.171238 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171214    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:09:20.171518 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171506    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container"
Sep 17 18:09:20.171569 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171519    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container"
Sep 17 18:09:20.171569 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171526    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kube-rbac-proxy"
Sep 17 18:09:20.171569 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171533    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kube-rbac-proxy"
Sep 17 18:09:20.171658 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171578    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kserve-container"
Sep 17 18:09:20.171658 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.171585    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="32d333de-924f-4d2e-a6b7-ac3f05b5fcc1" containerName="kube-rbac-proxy"
Sep 17 18:09:20.174815 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.174800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.181065 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:20.181037    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" podUID="9fd09c19-f729-458e-902d-91771fb05146" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.181158 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:20.181102    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"success-200-isvc-892d5-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-892d5-predictor-serving-cert\"" type="*v1.Secret"
Sep 17 18:09:20.181417 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:20.181397    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"success-200-isvc-892d5-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-134-158.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-158.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-892d5-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap"
Sep 17 18:09:20.222646 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.222617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:09:20.280302 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.280273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.280407 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.280304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clvrs\" (UniqueName: \"kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.280407 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.280370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.292830 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.292805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:20.381021 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.380947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.381021 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.381012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.381189 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.381044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clvrs\" (UniqueName: \"kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.388110 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.388086    2581 generic.go:356] "Generic (PLEG): container finished" podID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerID="ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b" exitCode=2
Sep 17 18:09:20.388203 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.388143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerDied","Data":"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"}
Sep 17 18:09:20.393255 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.393236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clvrs\" (UniqueName: \"kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:20.728759 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:20.728656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:21.023168 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.023083    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-892d5-kube-rbac-proxy-sar-config\""
Sep 17 18:09:21.031736 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.031708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:21.381592 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:21.381557    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-892d5-predictor-serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 17 18:09:21.381744 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:21.381637    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls podName:9fd09c19-f729-458e-902d-91771fb05146 nodeName:}" failed. No retries permitted until 2026-09-17 18:09:21.881619609 +0000 UTC m=+2091.188505600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls") pod "success-200-isvc-892d5-predictor-b75d9549f-ffcm2" (UID: "9fd09c19-f729-458e-902d-91771fb05146") : failed to sync secret cache: timed out waiting for the condition
Sep 17 18:09:21.651861 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.651782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-892d5-predictor-serving-cert\""
Sep 17 18:09:21.891650 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.891620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:21.894053 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.894034    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") pod \"success-200-isvc-892d5-predictor-b75d9549f-ffcm2\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") " pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:21.984441 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:21.984359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:22.257129 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.257103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:09:22.259459 ip-10-0-134-158 kubenswrapper[2581]: W0917 18:09:22.259431    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd09c19_f729_458e_902d_91771fb05146.slice/crio-de572723e7d33e4005cc63105bcea3e5a7bb267a650cc1f06438b7c453e7e1ac WatchSource:0}: Error finding container de572723e7d33e4005cc63105bcea3e5a7bb267a650cc1f06438b7c453e7e1ac: Status 404 returned error can't find the container with id de572723e7d33e4005cc63105bcea3e5a7bb267a650cc1f06438b7c453e7e1ac
Sep 17 18:09:22.397468 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.397444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerStarted","Data":"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"}
Sep 17 18:09:22.397584 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.397523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerStarted","Data":"de572723e7d33e4005cc63105bcea3e5a7bb267a650cc1f06438b7c453e7e1ac"}
Sep 17 18:09:22.585761 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.585738    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:09:22.698578 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.698555    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config\") pod \"f98ec658-9c1e-44a5-870d-c315c2612a32\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") "
Sep 17 18:09:22.698715 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.698610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") pod \"f98ec658-9c1e-44a5-870d-c315c2612a32\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") "
Sep 17 18:09:22.698715 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.698646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p78m6\" (UniqueName: \"kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6\") pod \"f98ec658-9c1e-44a5-870d-c315c2612a32\" (UID: \"f98ec658-9c1e-44a5-870d-c315c2612a32\") "
Sep 17 18:09:22.698901 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.698859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f98ec658-9c1e-44a5-870d-c315c2612a32" (UID: "f98ec658-9c1e-44a5-870d-c315c2612a32"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:09:22.700684 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.700658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f98ec658-9c1e-44a5-870d-c315c2612a32" (UID: "f98ec658-9c1e-44a5-870d-c315c2612a32"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:09:22.700775 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.700757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6" (OuterVolumeSpecName: "kube-api-access-p78m6") pod "f98ec658-9c1e-44a5-870d-c315c2612a32" (UID: "f98ec658-9c1e-44a5-870d-c315c2612a32"). InnerVolumeSpecName "kube-api-access-p78m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:09:22.799548 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.799526    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f98ec658-9c1e-44a5-870d-c315c2612a32-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:09:22.799548 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.799546    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p78m6\" (UniqueName: \"kubernetes.io/projected/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-api-access-p78m6\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:09:22.799667 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:22.799556    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f98ec658-9c1e-44a5-870d-c315c2612a32-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:09:23.402577 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.402542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerStarted","Data":"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"}
Sep 17 18:09:23.403063 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.402614    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:23.403063 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.402651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:23.404276 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404246    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:09:23.404401 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404376    2581 generic.go:356] "Generic (PLEG): container finished" podID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerID="937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88" exitCode=0
Sep 17 18:09:23.404449 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerDied","Data":"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"}
Sep 17 18:09:23.404449 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"
Sep 17 18:09:23.404561 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404503    2581 scope.go:117] "RemoveContainer" containerID="ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"
Sep 17 18:09:23.404561 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.404504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz" event={"ID":"f98ec658-9c1e-44a5-870d-c315c2612a32","Type":"ContainerDied","Data":"1e3dad3b4cc15963a3919d65e550c66caf19fa1592e6b07bd6f30218187a51ff"}
Sep 17 18:09:23.412678 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.412662    2581 scope.go:117] "RemoveContainer" containerID="937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"
Sep 17 18:09:23.420775 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.420753    2581 scope.go:117] "RemoveContainer" containerID="ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"
Sep 17 18:09:23.421077 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:23.421055    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b\": container with ID starting with ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b not found: ID does not exist" containerID="ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"
Sep 17 18:09:23.421151 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.421087    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b"} err="failed to get container status \"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b\": rpc error: code = NotFound desc = could not find container \"ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b\": container with ID starting with ff7d088b1455cad26c04223a64b9850cf0d6ba22f439a192db58c03a8949421b not found: ID does not exist"
Sep 17 18:09:23.421151 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.421103    2581 scope.go:117] "RemoveContainer" containerID="937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"
Sep 17 18:09:23.421431 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:09:23.421412    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88\": container with ID starting with 937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88 not found: ID does not exist" containerID="937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"
Sep 17 18:09:23.421519 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.421438    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88"} err="failed to get container status \"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88\": rpc error: code = NotFound desc = could not find container \"937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88\": container with ID starting with 937810397d3ee880900f0e73cc48bed535661c1ae9f7cff6122b002fba925f88 not found: ID does not exist"
Sep 17 18:09:23.424562 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.424523    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podStartSLOduration=3.424511483 podStartE2EDuration="3.424511483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:09:23.4215697 +0000 UTC m=+2092.728455716" watchObservedRunningTime="2026-09-17 18:09:23.424511483 +0000 UTC m=+2092.731397494"
Sep 17 18:09:23.437685 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.437664    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:09:23.442356 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:23.442339    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-9819a-predictor-69df5dcdcf-bn5vz"]
Sep 17 18:09:24.312665 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:24.312625    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:09:24.410295 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:24.410260    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:09:24.807099 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:24.807066    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" path="/var/lib/kubelet/pods/f98ec658-9c1e-44a5-870d-c315c2612a32/volumes"
Sep 17 18:09:29.414511 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:29.414462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:09:29.414882 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:29.414858    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:09:32.787847 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:32.787821    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:09:32.792737 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:32.792718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:09:34.313182 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:34.313146    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Sep 17 18:09:39.415592 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:39.415553    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:09:44.313249 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:44.313215    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:09:49.414989 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:49.414951    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:09:56.220339 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:56.220302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:56.531187 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:56.531144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:59.415751 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:09:59.415701    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Sep 17 18:10:09.415655 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:10:09.415624    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:10:20.044581 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:10:20.044550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:10:20.167536 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:10:20.167496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:05.326333 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:13:05.326295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:34.459864 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:13:34.459753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:36.818731 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:13:36.818690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:14:32.812438 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:14:32.812407    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:14:32.817404 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:14:32.817380    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:16:53.588692 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:16:53.588654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:05.801866 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:17:05.801790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:28.328496 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:28.328432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:34.539015 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.538967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:34.642608 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.642577    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:18:34.642934 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.642907    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container" containerID="cri-o://276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8" gracePeriod=30
Sep 17 18:18:34.643015 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.642967    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kube-rbac-proxy" containerID="cri-o://eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23" gracePeriod=30
Sep 17 18:18:34.667049 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.667021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:34.727534 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:34.727509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:35.576145 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:35.576114    2581 generic.go:356] "Generic (PLEG): container finished" podID="9fd09c19-f729-458e-902d-91771fb05146" containerID="eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23" exitCode=2
Sep 17 18:18:35.576548 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:35.576164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerDied","Data":"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"}
Sep 17 18:18:36.880834 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:36.880812    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:18:37.018828 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.018768    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clvrs\" (UniqueName: \"kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs\") pod \"9fd09c19-f729-458e-902d-91771fb05146\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") "
Sep 17 18:18:37.018946 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.018856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config\") pod \"9fd09c19-f729-458e-902d-91771fb05146\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") "
Sep 17 18:18:37.018946 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.018900    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") pod \"9fd09c19-f729-458e-902d-91771fb05146\" (UID: \"9fd09c19-f729-458e-902d-91771fb05146\") "
Sep 17 18:18:37.019215 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.019188    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9fd09c19-f729-458e-902d-91771fb05146" (UID: "9fd09c19-f729-458e-902d-91771fb05146"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:18:37.021008 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.020981    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9fd09c19-f729-458e-902d-91771fb05146" (UID: "9fd09c19-f729-458e-902d-91771fb05146"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:18:37.021164 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.021147    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs" (OuterVolumeSpecName: "kube-api-access-clvrs") pod "9fd09c19-f729-458e-902d-91771fb05146" (UID: "9fd09c19-f729-458e-902d-91771fb05146"). InnerVolumeSpecName "kube-api-access-clvrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:18:37.119790 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.119766    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fd09c19-f729-458e-902d-91771fb05146-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:18:37.119790 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.119785    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fd09c19-f729-458e-902d-91771fb05146-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:18:37.119911 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.119795    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clvrs\" (UniqueName: \"kubernetes.io/projected/9fd09c19-f729-458e-902d-91771fb05146-kube-api-access-clvrs\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:18:37.586325 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.586291    2581 generic.go:356] "Generic (PLEG): container finished" podID="9fd09c19-f729-458e-902d-91771fb05146" containerID="276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8" exitCode=0
Sep 17 18:18:37.586460 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.586348    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"
Sep 17 18:18:37.586460 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.586371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerDied","Data":"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"}
Sep 17 18:18:37.586460 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.586433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2" event={"ID":"9fd09c19-f729-458e-902d-91771fb05146","Type":"ContainerDied","Data":"de572723e7d33e4005cc63105bcea3e5a7bb267a650cc1f06438b7c453e7e1ac"}
Sep 17 18:18:37.586603 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.586462    2581 scope.go:117] "RemoveContainer" containerID="eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"
Sep 17 18:18:37.595791 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.595777    2581 scope.go:117] "RemoveContainer" containerID="276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"
Sep 17 18:18:37.603145 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.603130    2581 scope.go:117] "RemoveContainer" containerID="eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"
Sep 17 18:18:37.603423 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:18:37.603406    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23\": container with ID starting with eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23 not found: ID does not exist" containerID="eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"
Sep 17 18:18:37.603580 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.603429    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23"} err="failed to get container status \"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23\": rpc error: code = NotFound desc = could not find container \"eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23\": container with ID starting with eb4503210d24d484fd979ace1335b72ea4b5dbaec9977896fcac781854bcfc23 not found: ID does not exist"
Sep 17 18:18:37.603580 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.603446    2581 scope.go:117] "RemoveContainer" containerID="276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"
Sep 17 18:18:37.603739 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:18:37.603723    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8\": container with ID starting with 276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8 not found: ID does not exist" containerID="276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"
Sep 17 18:18:37.603779 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.603742    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8"} err="failed to get container status \"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8\": rpc error: code = NotFound desc = could not find container \"276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8\": container with ID starting with 276a39952182f0e76a73ab8d01dbf81782cfb4677096f94dde8a78649710eab8 not found: ID does not exist"
Sep 17 18:18:37.611227 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.611199    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:18:37.617852 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:37.617824    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-892d5-predictor-b75d9549f-ffcm2"]
Sep 17 18:18:38.807596 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:18:38.807537    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fd09c19-f729-458e-902d-91771fb05146" path="/var/lib/kubelet/pods/9fd09c19-f729-458e-902d-91771fb05146/volumes"
Sep 17 18:19:32.835252 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:19:32.835170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:19:32.841444 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:19:32.841424    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:22:48.685218 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:22:48.685126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:24:32.857233 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:24:32.857204    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:24:32.863738 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:24:32.863717    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:26:15.391298 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.391259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:15.448257 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.448226    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:26:15.448456 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.448431    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container" containerID="cri-o://c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411" gracePeriod=30
Sep 17 18:26:15.448566 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.448512    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kube-rbac-proxy" containerID="cri-o://4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5" gracePeriod=30
Sep 17 18:26:15.472696 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.472667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:15.545770 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:15.545743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:16.296057 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:16.296023    2581 generic.go:356] "Generic (PLEG): container finished" podID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerID="4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5" exitCode=2
Sep 17 18:26:16.296235 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:16.296072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerDied","Data":"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"}
Sep 17 18:26:16.553353 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:16.553281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:16.626940 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:16.626907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:17.893295 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:17.893273    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:26:18.007554 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.007498    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls\") pod \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") "
Sep 17 18:26:18.007554 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.007536    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5l7d\" (UniqueName: \"kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d\") pod \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") "
Sep 17 18:26:18.007731 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.007557    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config\") pod \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\" (UID: \"cc174225-a213-4d46-8daa-3fb53fb0c9fb\") "
Sep 17 18:26:18.007914 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.007891    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cc174225-a213-4d46-8daa-3fb53fb0c9fb" (UID: "cc174225-a213-4d46-8daa-3fb53fb0c9fb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:26:18.009692 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.009667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cc174225-a213-4d46-8daa-3fb53fb0c9fb" (UID: "cc174225-a213-4d46-8daa-3fb53fb0c9fb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:26:18.009808 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.009762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d" (OuterVolumeSpecName: "kube-api-access-t5l7d") pod "cc174225-a213-4d46-8daa-3fb53fb0c9fb" (UID: "cc174225-a213-4d46-8daa-3fb53fb0c9fb"). InnerVolumeSpecName "kube-api-access-t5l7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:26:18.108914 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.108890    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc174225-a213-4d46-8daa-3fb53fb0c9fb-proxy-tls\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:26:18.108914 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.108909    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5l7d\" (UniqueName: \"kubernetes.io/projected/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-api-access-t5l7d\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:26:18.109023 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.108918    2581 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc174225-a213-4d46-8daa-3fb53fb0c9fb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-158.ec2.internal\" DevicePath \"\""
Sep 17 18:26:18.305026 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.304995    2581 generic.go:356] "Generic (PLEG): container finished" podID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerID="c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411" exitCode=0
Sep 17 18:26:18.305178 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.305050    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"
Sep 17 18:26:18.305178 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.305046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerDied","Data":"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"}
Sep 17 18:26:18.305178 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.305171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt" event={"ID":"cc174225-a213-4d46-8daa-3fb53fb0c9fb","Type":"ContainerDied","Data":"cf6d057a0c2d66446c5724343f77ef0015e7f5e9990d85931c72c8b0511e7076"}
Sep 17 18:26:18.305294 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.305199    2581 scope.go:117] "RemoveContainer" containerID="4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"
Sep 17 18:26:18.314133 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.314112    2581 scope.go:117] "RemoveContainer" containerID="c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"
Sep 17 18:26:18.321155 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.321140    2581 scope.go:117] "RemoveContainer" containerID="4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"
Sep 17 18:26:18.321412 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:26:18.321398    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5\": container with ID starting with 4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5 not found: ID does not exist" containerID="4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"
Sep 17 18:26:18.321451 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.321422    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5"} err="failed to get container status \"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5\": rpc error: code = NotFound desc = could not find container \"4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5\": container with ID starting with 4927f7eef51a1f1c8f0c806a350fcfbbc66cd29a5eae40dfcc9e72d93299b2f5 not found: ID does not exist"
Sep 17 18:26:18.321451 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.321438    2581 scope.go:117] "RemoveContainer" containerID="c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"
Sep 17 18:26:18.321681 ip-10-0-134-158 kubenswrapper[2581]: E0917 18:26:18.321665    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411\": container with ID starting with c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411 not found: ID does not exist" containerID="c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"
Sep 17 18:26:18.321738 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.321686    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411"} err="failed to get container status \"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411\": rpc error: code = NotFound desc = could not find container \"c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411\": container with ID starting with c04796d64f3ccae4305023cf365cb76c83edbac99a7c4fc6d580a50065bc4411 not found: ID does not exist"
Sep 17 18:26:18.331624 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.330862    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:26:18.335763 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.335740    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5ec4c-predictor-5d6f7b484c-9z4xt"]
Sep 17 18:26:18.807491 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:18.807450    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" path="/var/lib/kubelet/pods/cc174225-a213-4d46-8daa-3fb53fb0c9fb/volumes"
Sep 17 18:26:47.668748 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:47.668655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:47.818012 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:47.817962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:47.915275 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:47.915236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:50.850718 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:50.850684    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lh6dh_c9042abd-a685-4928-9802-0a0e4fa84d8f/global-pull-secret-syncer/0.log"
Sep 17 18:26:50.904170 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:50.904144    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log"
Sep 17 18:26:51.114411 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:51.114340    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-158.ec2.internal_3564b9943b12f3f32f2d5c68ae2dba3e/haproxy/0.log"
Sep 17 18:26:53.466188 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:53.466156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:53.568159 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:53.568126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-849lz_c7a5a49f-56e1-49ac-9b59-d621137a02fc/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:55.664741 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.664709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84tj7_b506015f-d2ef-4842-9f60-8d0bde028bd9/node-exporter/0.log"
Sep 17 18:26:55.695888 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.695862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84tj7_b506015f-d2ef-4842-9f60-8d0bde028bd9/kube-rbac-proxy/0.log"
Sep 17 18:26:55.725691 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.725665    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-84tj7_b506015f-d2ef-4842-9f60-8d0bde028bd9/init-textfile/0.log"
Sep 17 18:26:55.932383 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.932315    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-d24p5_058fa105-9147-40a9-ac5a-b0c22512c095/kube-rbac-proxy-main/0.log"
Sep 17 18:26:55.959952 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.959924    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-d24p5_058fa105-9147-40a9-ac5a-b0c22512c095/kube-rbac-proxy-self/0.log"
Sep 17 18:26:55.986187 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:55.986166    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-d24p5_058fa105-9147-40a9-ac5a-b0c22512c095/openshift-state-metrics/0.log"
Sep 17 18:26:58.530466 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530429    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"]
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530749    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kube-rbac-proxy"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530765    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kube-rbac-proxy"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530775    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530781    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530792    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530798    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530806    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kube-rbac-proxy"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530811    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kube-rbac-proxy"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530817    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530823    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530832    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kube-rbac-proxy"
Sep 17 18:26:58.530865 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530837    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kube-rbac-proxy"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530881    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kserve-container"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530888    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kserve-container"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530894    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kserve-container"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530902    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f98ec658-9c1e-44a5-870d-c315c2612a32" containerName="kube-rbac-proxy"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530908    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc174225-a213-4d46-8daa-3fb53fb0c9fb" containerName="kube-rbac-proxy"
Sep 17 18:26:58.531213 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.530913    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd09c19-f729-458e-902d-91771fb05146" containerName="kube-rbac-proxy"
Sep 17 18:26:58.535005 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.534984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.539190 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.539171    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffk4x\"/\"kube-root-ca.crt\""
Sep 17 18:26:58.539301 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.539211    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffk4x\"/\"openshift-service-ca.crt\""
Sep 17 18:26:58.539301 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.539223    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ffk4x\"/\"default-dockercfg-lw4rk\""
Sep 17 18:26:58.543643 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.543619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"]
Sep 17 18:26:58.673971 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.673947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-podres\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.674081 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.673974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-proc\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.674081 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.673996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjs8\" (UniqueName: \"kubernetes.io/projected/0330ce97-063b-4b7d-b936-f4dea60cbd8e-kube-api-access-bfjs8\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.674081 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.674050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-sys\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.674220 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.674094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-lib-modules\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774821 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-podres\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774821 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-proc\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774986 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjs8\" (UniqueName: \"kubernetes.io/projected/0330ce97-063b-4b7d-b936-f4dea60cbd8e-kube-api-access-bfjs8\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774986 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-sys\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774986 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-podres\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774986 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-lib-modules\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.774986 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-proc\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.775175 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.774965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-sys\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.775175 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.775065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0330ce97-063b-4b7d-b936-f4dea60cbd8e-lib-modules\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.785856 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.785795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjs8\" (UniqueName: \"kubernetes.io/projected/0330ce97-063b-4b7d-b936-f4dea60cbd8e-kube-api-access-bfjs8\") pod \"perf-node-gather-daemonset-47f5p\" (UID: \"0330ce97-063b-4b7d-b936-f4dea60cbd8e\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:58.845249 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:58.845230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:59.117995 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:59.117900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"]
Sep 17 18:26:59.121106 ip-10-0-134-158 kubenswrapper[2581]: W0917 18:26:59.121080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0330ce97_063b_4b7d_b936_f4dea60cbd8e.slice/crio-e168e80436053ff6202cbf7534eba92af4866e9fd1f892443d624d142a422fa2 WatchSource:0}: Error finding container e168e80436053ff6202cbf7534eba92af4866e9fd1f892443d624d142a422fa2: Status 404 returned error can't find the container with id e168e80436053ff6202cbf7534eba92af4866e9fd1f892443d624d142a422fa2
Sep 17 18:26:59.459076 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:59.459002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p" event={"ID":"0330ce97-063b-4b7d-b936-f4dea60cbd8e","Type":"ContainerStarted","Data":"214445e2d1ba7c5de52306805ec3da605558429de7c97bf0add8061631e88cee"}
Sep 17 18:26:59.459192 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:59.459099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p" event={"ID":"0330ce97-063b-4b7d-b936-f4dea60cbd8e","Type":"ContainerStarted","Data":"e168e80436053ff6202cbf7534eba92af4866e9fd1f892443d624d142a422fa2"}
Sep 17 18:26:59.459192 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:59.459130    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:26:59.477999 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:26:59.477955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p" podStartSLOduration=1.4779407469999999 podStartE2EDuration="1.477940747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:26:59.476935103 +0000 UTC m=+3148.783821128" watchObservedRunningTime="2026-09-17 18:26:59.477940747 +0000 UTC m=+3148.784826760"
Sep 17 18:27:00.409827 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:00.409782    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22ktf_0e8d3677-ee10-4607-be7c-930124be8e52/dns/0.log"
Sep 17 18:27:00.435583 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:00.435552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22ktf_0e8d3677-ee10-4607-be7c-930124be8e52/kube-rbac-proxy/0.log"
Sep 17 18:27:00.605581 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:00.605561    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dqxrl_d046e3fc-29d6-405e-a0d2-5d6419a5a71e/dns-node-resolver/0.log"
Sep 17 18:27:01.129873 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:01.129844    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6smjf_a36a4e87-d8e8-4814-a87f-da58c1c478e9/node-ca/0.log"
Sep 17 18:27:02.317568 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:02.317539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j7hfk_0ef46462-a0b3-46ed-a772-01f4d6fa5771/serve-healthcheck-canary/0.log"
Sep 17 18:27:02.956871 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:02.956842    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r24vk_6f6680fe-a226-4440-b29c-5f2959f7199f/kube-rbac-proxy/0.log"
Sep 17 18:27:02.987200 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:02.987172    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r24vk_6f6680fe-a226-4440-b29c-5f2959f7199f/exporter/0.log"
Sep 17 18:27:03.024644 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:03.024619    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r24vk_6f6680fe-a226-4440-b29c-5f2959f7199f/extractor/0.log"
Sep 17 18:27:05.474089 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:05.474056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-47f5p"
Sep 17 18:27:05.639830 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:05.639804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-nbs7z_a043a9e1-c1e5-411b-b52f-ecf89272cb3d/manager/0.log"
Sep 17 18:27:12.662800 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.662775    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/kube-multus-additional-cni-plugins/0.log"
Sep 17 18:27:12.717001 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.716974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/egress-router-binary-copy/0.log"
Sep 17 18:27:12.753060 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.753034    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/cni-plugins/0.log"
Sep 17 18:27:12.784563 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.784543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/bond-cni-plugin/0.log"
Sep 17 18:27:12.811774 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.811759    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/routeoverride-cni/0.log"
Sep 17 18:27:12.837145 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.837126    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/whereabouts-cni-bincopy/0.log"
Sep 17 18:27:12.864035 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:12.864014    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rq9mv_ae36ae40-d704-46ac-af5d-2d102b25cb51/whereabouts-cni/0.log"
Sep 17 18:27:13.000546 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:13.000499    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ppzvm_e901ce13-a6bc-4bec-9ef9-80933789d83b/kube-multus/0.log"
Sep 17 18:27:13.027785 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:13.027768    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d49h2_49f5f083-0838-433b-b94d-3d5d37b65797/network-metrics-daemon/0.log"
Sep 17 18:27:13.055741 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:13.055724    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d49h2_49f5f083-0838-433b-b94d-3d5d37b65797/kube-rbac-proxy/0.log"
Sep 17 18:27:14.487760 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.487734    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-controller/0.log"
Sep 17 18:27:14.516445 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.516414    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/0.log"
Sep 17 18:27:14.516584 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.516427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovn-acl-logging/1.log"
Sep 17 18:27:14.539956 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.539934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/kube-rbac-proxy-node/0.log"
Sep 17 18:27:14.566127 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.566106    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 18:27:14.594435 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.594416    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/northd/0.log"
Sep 17 18:27:14.644860 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.644838    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/nbdb/0.log"
Sep 17 18:27:14.693149 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.693135    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/sbdb/0.log"
Sep 17 18:27:14.747452 ip-10-0-134-158 kubenswrapper[2581]: I0917 18:27:14.747392    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q9bgc_bb146d57-9f25-468d-8676-ab37786ff2b6/ovnkube-controller/0.log"