Sep 17 15:37:06.664792 ip-10-0-128-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 15:37:06.664805 ip-10-0-128-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 15:37:06.664811 ip-10-0-128-116 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 15:37:06.665045 ip-10-0-128-116 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 15:37:17.878378 ip-10-0-128-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 15:37:17.878394 ip-10-0-128-116 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 42dba042c8d44be5be0a895906c10579 --
Sep 17 15:38:53.216540 ip-10-0-128-116 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 15:38:53.631485 ip-10-0-128-116 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:53.631485 ip-10-0-128-116 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 15:38:53.631485 ip-10-0-128-116 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:53.631485 ip-10-0-128-116 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 15:38:53.631485 ip-10-0-128-116 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:53.632614 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.632531    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 15:38:53.636807 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636793    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.636807 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636808    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636811    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636815    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636818    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636821    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636824    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636827    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636829    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636832    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636835    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636837    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636842    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636844    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636847    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636849    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636852    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636854    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636857    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636859    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636862    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.636872 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636864    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636867    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636869    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636872    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636875    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636877    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636880    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636883    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636886    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636889    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636891    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636895    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636897    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636900    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636903    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636906    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636908    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636913    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636916    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636919    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.637356 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636922    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636925    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636928    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636930    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636933    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636936    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636938    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636944    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636947    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636950    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636953    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636955    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636958    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636961    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636964    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636967    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636970    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636972    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636975    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.637843 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636978    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636980    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636983    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636986    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636989    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636991    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636994    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636996    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.636999    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637001    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637004    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637007    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637009    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637012    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637014    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637017    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637019    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637022    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637025    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637027    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.638311 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637030    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637032    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637038    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637042    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637044    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637047    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637052    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637054    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637057    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637060    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637062    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637065    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637068    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637070    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637073    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637076    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637078    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637081    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637084    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.638822 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637859    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637866    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637869    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637873    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637875    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637878    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637881    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637883    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637886    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637889    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637892    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637894    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637897    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637900    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637903    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637907    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637910    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637913    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637916    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.639286 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637921    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637924    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637928    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637931    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637933    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637936    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637939    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637942    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637945    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637948    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637951    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637956    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637959    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637962    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637965    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637969    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637972    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637975    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637977    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637980    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.639771 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637983    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637986    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637988    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637991    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637993    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637996    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.637999    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638002    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638004    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638007    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638011    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638014    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638018    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638021    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638023    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638026    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638028    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638031    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638034    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.640269 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638036    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638039    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638041    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638044    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638046    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638049    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638051    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638054    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638057    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638059    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638062    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638064    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638067    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638070    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638072    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638075    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638077    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638080    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638082    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638085    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.640759 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638090    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638093    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638096    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638098    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638101    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638103    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638106    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638108    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638111    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638114    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638116    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638119    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638121    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638124    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638126    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638129    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638132    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638134    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638137    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638139    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.641354 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638143    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638536    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638542    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638545    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638548    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638550    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638553    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638556    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638558    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638562    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638579    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638585    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638590    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638595    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638598    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638601    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638604    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638606    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638609    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638612    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.641833 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638614    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638617    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638620    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638622    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638625    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638627    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638630    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638633    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638636    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638638    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638641    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638644    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638651    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638655    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638658    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638661    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638663    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638666    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638668    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.642331 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638671    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638674    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638678    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638681    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638683    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638686    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638689    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638692    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638695    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638697    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638700    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638703    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638705    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638708    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638710    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638712    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638715    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638718    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638721    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.642789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638723    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638725    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638728    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638731    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638733    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638736    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638740    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638742    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638745    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638748    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638751    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638753    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638756    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638758    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638761    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638763    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638766    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638768    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638770    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638773    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.643243 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638776    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638778    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638780    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638783    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638785    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638788    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638790    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638792    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638795    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638797    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638800    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638804    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638807    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638810    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638812    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638816    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638818    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638821    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638825    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.643766 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638828    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638831    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.638834    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638915    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638956    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638963    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638967    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638972    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638976    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638980    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638985    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638988    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638991    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638995    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.638999    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639002    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639005    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639008    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639011    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639014    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639017    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639020    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639023    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639026    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 15:38:53.644232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639029    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639032    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639036    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639039    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639044    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639047    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639050    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639055    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639058    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639061    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639064    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639068    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639072    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639075    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639078    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639082    2568 flags.go:64] FLAG: --enable-server="true"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639085    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639089    2568 flags.go:64] FLAG: --event-burst="100"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639092    2568 flags.go:64] FLAG: --event-qps="50"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639095    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639098    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639100    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639104    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639108    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639111    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 15:38:53.644822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639114    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639117    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639119    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639122    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639125    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639128    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639131    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639134    2568 flags.go:64] FLAG: --feature-gates=""
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639137    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639140    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639143    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639148    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639151    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639153    2568 flags.go:64] FLAG: --help="false"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639157    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639161    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639164    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639167    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639170    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639174    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639176    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639179    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639182    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 15:38:53.645430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639185    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639188    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639191    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639194    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639197    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639199    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639202    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639205    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639208    2568 flags.go:64] FLAG: --lock-file=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639211    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639214    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639217    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639222    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639225    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639228    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639231    2568 flags.go:64] FLAG: --logging-format="text"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639233    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639237    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639239    2568 flags.go:64] FLAG: --manifest-url=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639242    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639249    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639252    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639256    2568 flags.go:64] FLAG: --max-pods="110"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639260    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639263    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 15:38:53.646018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639266    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639282    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639286    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639289    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639292    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639300    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639303    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639306    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639309    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639312    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639318    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639321    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639324    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639327    2568 flags.go:64] FLAG: --port="10250"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639330    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639333    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-003324ab8d7f56fcb"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639337    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639340    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639343    2568 flags.go:64] FLAG: --register-node="true"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639346    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639349    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639352    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639355    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639358    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639361    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 15:38:53.646637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639364    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639367    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639370    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639374    2568 flags.go:64] FLAG: --runonce="false"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639377    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639381    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639384    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639387    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639390    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639393    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639396    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639399    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639402    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639405    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639408    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639411    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639414    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639417    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639420    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639425    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639428    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639431    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639434    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639437    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639440    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 15:38:53.647325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639443    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639446    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639449    2568 flags.go:64] FLAG: --v="2"
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639453    2568 flags.go:64] FLAG: --version="false"
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639456    2568 flags.go:64] FLAG: --vmodule=""
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639460    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.639463    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639605    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639609    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639612    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639616    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639619    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639622    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639624    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639627    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639630    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639633    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639635    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639638    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639640    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.648156 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639645    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639648    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639651    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639654    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639657    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639659    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639663    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639667    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639670    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639672    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639675    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639678    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639681    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639684    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639687    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639689    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639692    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639694    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639697    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639700    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.648837 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639703    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639705    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639709    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639712    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639714    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639717    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639720    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639722    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639725    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639727    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639730    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639732    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639735    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639737    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639740    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639742    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639745    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639747    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639750    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639753    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.649337 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639755    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639758    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639760    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639763    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639765    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639768    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639771    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639774    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639777    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639780    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639782    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639785    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639787    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639790    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639803    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639806    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639809    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639811    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639814    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639816    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.649839 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639819    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639822    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639825    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639828    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639830    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639833    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639835    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639838    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639840    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639843    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639845    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639848    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639850    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639853    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639855    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639858    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639860    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639863    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639866    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.650333 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639869    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639873    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639876    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639879    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639881    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639884    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.639886    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.650803 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.640636    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:53.651021 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651004    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 15:38:53.651021 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651021    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 15:38:53.651077 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651046    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 15:38:53.651077 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651052    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 15:38:53.651128 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651112    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.651128 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651119    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.651128 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651123    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.651128 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651127    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651131    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651135    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651137    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651140    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651143    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651145    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651148    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651151    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651153    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651156    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651158    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651161    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651164    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651167    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651169    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651172    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651174    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651176    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.651227 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651179    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651181    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651184    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651187    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651189    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651191    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651194    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651197    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651199    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651202    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651204    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651207    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651209    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651211    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651214    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651217    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651220    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651223    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651225    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651228    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.651707 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651231    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651233    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651236    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651238    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651242    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651244    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651247    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651249    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651252    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651254    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651257    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651259    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651262    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651264    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651267    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651286    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651290    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651294    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651296    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651299    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.652207 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651302    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651304    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651307    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651309    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651312    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651314    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651317    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651320    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651323    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651325    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651328    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651330    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651333    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651336    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651338    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651341    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651344    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651347    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651352    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.652699 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651355    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651358    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651361    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651363    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651366    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651369    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651371    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651374    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651376    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651379    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651382    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651385    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651387    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651390    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651392    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651395    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651397    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.653169 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651400    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651405    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651518    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651524    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651527    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651530    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651534    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651537    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651540    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651542    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651545    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651548    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651551    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651554    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651559    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:53.653613 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651562    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651564    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651567    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651570    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651572    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651575    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651577    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651580    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651582    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651585    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651587    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651590    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651592    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651595    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651597    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651599    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651602    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651605    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651607    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651610    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:53.653993 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651612    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651615    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651617    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651620    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651622    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651625    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651627    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651630    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651632    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651635    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651637    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651640    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651643    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651646    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651648    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651651    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651653    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651655    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651658    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651660    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:53.654486 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651663    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651665    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651668    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651670    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651673    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651675    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651678    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651680    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651683    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651685    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651688    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651691    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651693    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651696    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651698    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651700    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651703    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651706    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651709    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651713    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:53.654972 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651716    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651719    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651722    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651725    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651727    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651731    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651734    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651737    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651740    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651743    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651746    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651749    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651752    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651754    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651757    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651760    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651762    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651765    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651767    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:53.655457 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651770    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651772    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651774    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651777    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651780    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651782    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:53.651785    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651789    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.651899    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.654318    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.655469    2568 server.go:1019] "Starting client certificate rotation"
Sep 17 15:38:53.655923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.655571    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:38:53.656438 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.656426    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:38:53.658657 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.658643    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:38:53.659861 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.659845    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:38:53.676317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.676290    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 17 15:38:53.679680 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.679665    2568 log.go:25] "Validated CRI v1 image API"
Sep 17 15:38:53.680867 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.680851    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 15:38:53.685114 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.685092    2568 fs.go:135] Filesystem UUIDs: map[665daf5f-cdde-4387-8ca9-653b872d294e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cb74baaf-b878-4056-91c0-92ebf2a40d45:/dev/nvme0n1p3]
Sep 17 15:38:53.685180 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.685114    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 15:38:53.689438 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.689378    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:38:53.692653 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.692542    2568 manager.go:216] Machine: {Timestamp:2026-09-17 15:38:53.691011685 +0000 UTC m=+0.370618430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079286 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27464b2ba27567c529f8e3ef760121 SystemUUID:ec27464b-2ba2-7567-c529-f8e3ef760121 BootID:42dba042-c8d4-4be5-be0a-895906c10579 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:10:25:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:10:25:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:b6:e9:7f:cc:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 15:38:53.692653 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.692651    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 15:38:53.692777 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.692731    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 15:38:53.696422 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.696390    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 15:38:53.696577 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.696426    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 15:38:53.697329 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.697317    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 15:38:53.697391 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.697335    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 15:38:53.697391 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.697345    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:38:53.698163 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.698151    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:38:53.699738 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.699727    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 15:38:53.703988 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.703974    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:38:53.704127 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704116    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 15:38:53.704199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704157    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 15:38:53.704199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704171    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 15:38:53.704199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704190    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 15:38:53.704331 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704204    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 17 15:38:53.704331 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704214    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 15:38:53.704583 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704569    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:38:53.704639 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.704596    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:38:53.706931 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.706918    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 15:38:53.709820 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.709806    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 15:38:53.709867 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.709837    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 15:38:53.711859 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711846    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711864    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711869    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711874    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711883    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711889    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711903    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711908    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711915    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711921    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 15:38:53.711924 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711929    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 15:38:53.712171 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.711936    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 15:38:53.712777 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.712767    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 15:38:53.712777 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.712776    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 15:38:53.715170 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.715146    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 15:38:53.715247 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.715146    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 15:38:53.715247 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.715152    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 15:38:53.716602 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.716588    2568 server.go:1268] "Started kubelet"
Sep 17 15:38:53.716669 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.716649    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 15:38:53.716709 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.716670    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 15:38:53.716741 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.716725    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 15:38:53.717345 ip-10-0-128-116 systemd[1]: Started Kubernetes Kubelet.
Sep 17 15:38:53.718163 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.718147    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 15:38:53.719351 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.719334    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 15:38:53.721048 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.721027    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 15:38:53.725197 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.724129    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-116.ec2.internal.18d625dd28110934  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-116.ec2.internal,UID:ip-10-0-128-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-116.ec2.internal,},FirstTimestamp:2026-09-17 15:38:53.716556084 +0000 UTC m=+0.396162829,LastTimestamp:2026-09-17 15:38:53.716556084 +0000 UTC m=+0.396162829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-116.ec2.internal,}"
Sep 17 15:38:53.725958 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.725940    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 15:38:53.726597 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.726580    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 15:38:53.727239 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.727216    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:53.727669 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.727650    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 15:38:53.727781 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.727684    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 15:38:53.727781 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.727698    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 15:38:53.727886 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.727824    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 15:38:53.727886 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.727835    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 15:38:53.728016 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728002    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 15:38:53.728065 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728017    2568 factory.go:55] Registering systemd factory
Sep 17 15:38:53.728065 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728023    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 17 15:38:53.728286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728257    2568 factory.go:153] Registering CRI-O factory
Sep 17 15:38:53.728330 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728296    2568 factory.go:223] Registration of the crio container factory successfully
Sep 17 15:38:53.728330 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728317    2568 factory.go:103] Registering Raw factory
Sep 17 15:38:53.728330 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728331    2568 manager.go:1196] Started watching for new ooms in manager
Sep 17 15:38:53.728710 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.728698    2568 manager.go:349] Starting recovery of all containers
Sep 17 15:38:53.729824 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.729791    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 15:38:53.729919 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.729828    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 15:38:53.741801 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.741780    2568 manager.go:354] Recovery completed
Sep 17 15:38:53.742992 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.742975    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 17 15:38:53.745733 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.745722    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.747609 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.747581    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.747662 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.747618    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.747662 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.747634    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.748112 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748096    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 15:38:53.748112 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748113    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 15:38:53.748212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748117    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.748212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748133    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:38:53.748879 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748866    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.748921 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748893    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.748921 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.748905    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.749129 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.749118    2568 policy_none.go:49] "None policy: Start"
Sep 17 15:38:53.749164 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.749135    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 15:38:53.749164 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.749145    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 15:38:53.749750 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.749670    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-116.ec2.internal.18d625dd29eab414  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-116.ec2.internal,UID:ip-10-0-128-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-116.ec2.internal,},FirstTimestamp:2026-09-17 15:38:53.747598356 +0000 UTC m=+0.427205106,LastTimestamp:2026-09-17 15:38:53.747598356 +0000 UTC m=+0.427205106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-116.ec2.internal,}"
Sep 17 15:38:53.749969 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.749957    2568 policy_none.go:47] "Start"
Sep 17 15:38:53.753712 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.753693    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brwh4"
Sep 17 15:38:53.757967 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.757903    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-116.ec2.internal.18d625dd29eb1f12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-116.ec2.internal,UID:ip-10-0-128-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-116.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-116.ec2.internal,},FirstTimestamp:2026-09-17 15:38:53.747625746 +0000 UTC m=+0.427232493,LastTimestamp:2026-09-17 15:38:53.747625746 +0000 UTC m=+0.427232493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-116.ec2.internal,}"
Sep 17 15:38:53.761149 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.761134    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brwh4"
Sep 17 15:38:53.791841 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.791826    2568 manager.go:337] "Starting Device Plugin manager"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.791865    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.791875    2568 server.go:87] "Starting device plugin registration server"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.792112    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.792122    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.792198    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.792316    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.792327    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.792844    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 15:38:53.794123 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.792883    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:53.828207 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.828182    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 15:38:53.829475 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.829460    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 15:38:53.829547 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.829503    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 15:38:53.829547 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.829525    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 15:38:53.829645 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.829565    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 15:38:53.832569 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.832553    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:53.893166 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.892968    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.894045 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.894024    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.894123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.894060    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.894123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.894074    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.894123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.894122    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.901584 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.901568    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.901676 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.901604    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-116.ec2.internal\": node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:53.930281 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.930246    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"]
Sep 17 15:38:53.930400 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.930319    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.931681 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.931668    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.931746 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.931693    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.931746 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.931702    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.932947 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.932935    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.933053 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933040    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.933101 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933068    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.933593 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933577    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.933670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933584    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.933670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933630    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.933670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933644    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.933670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933609    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.933815 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.933674    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.934549 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.934533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.934624 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.934565    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:53.935324 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.935308    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:53.935407 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.935337    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:53.935407 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:53.935354    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:53.965833 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.965802    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:53.965935 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.965895    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-116.ec2.internal\" not found" node="ip-10-0-128-116.ec2.internal"
Sep 17 15:38:53.970331 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:53.970316    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-116.ec2.internal\" not found" node="ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.030050 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.030029    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.030131 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.030053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40c6e7c23f6418e0d386adbda44b2f29-config\") pod \"kube-apiserver-proxy-ip-10-0-128-116.ec2.internal\" (UID: \"40c6e7c23f6418e0d386adbda44b2f29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.030131 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.030071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.066093 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.066074    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.130556 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40c6e7c23f6418e0d386adbda44b2f29-config\") pod \"kube-apiserver-proxy-ip-10-0-128-116.ec2.internal\" (UID: \"40c6e7c23f6418e0d386adbda44b2f29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.130556 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.130698 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.130698 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.130698 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130615    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40c6e7c23f6418e0d386adbda44b2f29-config\") pod \"kube-apiserver-proxy-ip-10-0-128-116.ec2.internal\" (UID: \"40c6e7c23f6418e0d386adbda44b2f29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.130698 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.130641    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3e1f7a7e797a7c6cd70fdb40110517-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal\" (UID: \"fa3e1f7a7e797a7c6cd70fdb40110517\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.166840 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.166766    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.267442 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.267401    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.268526 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.268511    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.272923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.272906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.368540 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.368498    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.469016 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.468988    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.569542 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.569509    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.655009 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.654977    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 15:38:54.655527 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.655151    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 15:38:54.670299 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.670253    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-116.ec2.internal\" not found"
Sep 17 15:38:54.696032 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.696014    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:54.705170 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.705152    2568 apiserver.go:52] "Watching apiserver"
Sep 17 15:38:54.718189 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.718160    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 15:38:54.718499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.718479    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl","openshift-cluster-node-tuning-operator/tuned-c8zsh","openshift-image-registry/node-ca-cr8vq","openshift-network-operator/iptables-alerter-qz47z","openshift-ovn-kubernetes/ovnkube-node-n9zkq","kube-system/global-pull-secret-syncer-cp9kh","kube-system/konnectivity-agent-6dlfh","openshift-dns/node-resolver-mpll6","openshift-multus/multus-additional-cni-plugins-t7kqm","openshift-multus/multus-jdqlv","openshift-multus/network-metrics-daemon-gh8lz","openshift-network-diagnostics/network-check-target-pgml8"]
Sep 17 15:38:54.720972 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.720931    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.723036 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.723018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.725232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.725082    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.726760 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.726740    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 15:38:54.726856 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.726767    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.727234 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.727216    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.729511 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.729494    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.731001 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.730982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 15:38:54.731620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.731606    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.733055 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-log-socket\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733126 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-bin\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733126 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-netd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733126 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-device-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733126 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733287 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/561434f7-37d0-4656-a035-a9fad1e78bb4-iptables-alerter-script\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.733287 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-etc-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733287 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-env-overrides\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733318    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-modprobe-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-systemd\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-tmp\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-systemd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-host\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.733499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561434f7-37d0-4656-a035-a9fad1e78bb4-host-slash\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.733499 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733485    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-slash\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6qxn\" (UniqueName: \"kubernetes.io/projected/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kube-api-access-w6qxn\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-sys\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-systemd-units\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-node-log\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733570    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-config\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-lib-modules\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-host\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-serviceca\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.733666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-var-lib-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-run\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733766    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77ccc\" (UniqueName: \"kubernetes.io/projected/455e7480-ef99-4293-a424-813302afc1ab-kube-api-access-77ccc\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cccrp\" (UniqueName: \"kubernetes.io/projected/561434f7-37d0-4656-a035-a9fad1e78bb4-kube-api-access-cccrp\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-kubelet\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2127d592-38b5-48ec-854b-628e49ea1bab-ovn-node-metrics-cert\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-script-lib\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733876    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733908    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfl7p\" (UniqueName: \"kubernetes.io/projected/2127d592-38b5-48ec-854b-628e49ea1bab-kube-api-access-dfl7p\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733925    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733958    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.733983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.733980    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lhx\" (UniqueName: \"kubernetes.io/projected/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-kube-api-access-c4lhx\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-netns\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysconfig\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-conf\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-var-lib-kubelet\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734134    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-etc-tuned\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-ovn\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.734508 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.734194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-kubernetes\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.736146 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.736130    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.738245 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738067    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.738519 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.738653 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738637    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5pl2q\""
Sep 17 15:38:54.738835 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738818    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 15:38:54.738909 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738843    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.738909 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738854    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.739019 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738910    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 15:38:54.739019 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.738977    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkc9v\""
Sep 17 15:38:54.739111 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739081    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.739161 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739139    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.739210 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739163    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 15:38:54.739210 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739139    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qwmpb\""
Sep 17 15:38:54.739371 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739330    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 15:38:54.739488 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739415    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.739549 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 15:38:54.739645 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739627    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.739801 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739764    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.739894 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.739876    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4fplc\""
Sep 17 15:38:54.741221 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.741205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.741333 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.741312    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:38:54.742539 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742517    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gw5b\""
Sep 17 15:38:54.742635 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742575    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 15:38:54.742697 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742630    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.742697 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742642    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 15:38:54.742697 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742583    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 15:38:54.742821 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742639    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvsdv\""
Sep 17 15:38:54.742821 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.742758    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mmv47\""
Sep 17 15:38:54.743599 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.743579    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:54.743676 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.743617    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.743676 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.743642    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:38:54.744386 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.744371    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.745842 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.745826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.745910 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.745882    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:38:54.748381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.748013    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 15:38:54.748381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.748101    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 15:38:54.748381 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.748348    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal"]
Sep 17 15:38:54.749162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.748893    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 15:38:54.749162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.748963    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.749162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.749137    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q8wkw\""
Sep 17 15:38:54.750216 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.749204    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 15:38:54.750216 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.749608    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 15:38:54.750922 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.750552    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 15:38:54.750922 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.750595    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:38:54.750922 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.750633    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwjxk\""
Sep 17 15:38:54.750922 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.750674    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"
Sep 17 15:38:54.764846 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.764807    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 15:33:54 +0000 UTC" deadline="2028-07-02 22:32:19.151509312 +0000 UTC"
Sep 17 15:38:54.764846 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.764844    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15702h53m24.386667435s"
Sep 17 15:38:54.769339 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.769311    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:38:54.777535 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.777518    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6pxm"
Sep 17 15:38:54.786154 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.786137    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal"]
Sep 17 15:38:54.786763 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.786751    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:38:54.797248 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.797231    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6pxm"
Sep 17 15:38:54.828684 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.828667    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 15:38:54.831968 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:54.831934    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3e1f7a7e797a7c6cd70fdb40110517.slice/crio-8e6e345f88e3f6d40ff5971a6004fc61164cec50aacd30df80f792ce91989efe WatchSource:0}: Error finding container 8e6e345f88e3f6d40ff5971a6004fc61164cec50aacd30df80f792ce91989efe: Status 404 returned error can't find the container with id 8e6e345f88e3f6d40ff5971a6004fc61164cec50aacd30df80f792ce91989efe
Sep 17 15:38:54.832586 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:54.832566    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c6e7c23f6418e0d386adbda44b2f29.slice/crio-408532bd63476e51397632d0d82e78e593cdfcb4f583952f3df7fc947781cb0d WatchSource:0}: Error finding container 408532bd63476e51397632d0d82e78e593cdfcb4f583952f3df7fc947781cb0d: Status 404 returned error can't find the container with id 408532bd63476e51397632d0d82e78e593cdfcb4f583952f3df7fc947781cb0d
Sep 17 15:38:54.834787 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/561434f7-37d0-4656-a035-a9fad1e78bb4-iptables-alerter-script\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.834870 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.834870 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834818    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-systemd\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.834870 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-tmp\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.834870 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-socket-dir-parent\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.835041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-systemd\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhqf\" (UniqueName: \"kubernetes.io/projected/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-kube-api-access-rvhqf\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.835041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.834967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-systemd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-tmp-dir\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-systemd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-systemd-units\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-node-log\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-config\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-host\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-systemd-units\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cni-binary-copy\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835145    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-daemon-config\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-serviceca\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-host\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-var-lib-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-node-log\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-var-lib-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835368    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-run\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835431    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/561434f7-37d0-4656-a035-a9fad1e78bb4-iptables-alerter-script\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835527    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-run\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-kubelet\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2127d592-38b5-48ec-854b-628e49ea1bab-ovn-node-metrics-cert\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfl7p\" (UniqueName: \"kubernetes.io/projected/2127d592-38b5-48ec-854b-628e49ea1bab-kube-api-access-dfl7p\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-kubelet\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-var-lib-kubelet\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.835974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-conf-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-etc-kubernetes\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lhx\" (UniqueName: \"kubernetes.io/projected/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-kube-api-access-c4lhx\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-conf\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835801    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-etc-tuned\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-kubelet\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-hostroot\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835848    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-config\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-serviceca\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.835951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-var-lib-kubelet\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-conf\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86979\" (UniqueName: \"kubernetes.io/projected/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-kube-api-access-86979\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836081    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-kubernetes\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-log-socket\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-device-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.836973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836175    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-kubernetes\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-dbus\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-log-socket\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-etc-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-device-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-env-overrides\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836525    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-etc-openvswitch\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-modprobe-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysctl-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-k8s-cni-cncf-io\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836707    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-netns\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-modprobe-d\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-bin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.837973 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-env-overrides\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-multus-certs\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-host\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836847    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-host\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561434f7-37d0-4656-a035-a9fad1e78bb4-host-slash\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-slash\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836918    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-slash\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561434f7-37d0-4656-a035-a9fad1e78bb4-host-slash\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.836998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6qxn\" (UniqueName: \"kubernetes.io/projected/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kube-api-access-w6qxn\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837076    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-sys\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpn2m\" (UniqueName: \"kubernetes.io/projected/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-kube-api-access-cpn2m\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-multus\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837153    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-sys\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-lib-modules\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837195    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-system-cni-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.838959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cnibin\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-lib-modules\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77ccc\" (UniqueName: \"kubernetes.io/projected/455e7480-ef99-4293-a424-813302afc1ab-kube-api-access-77ccc\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cnibin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-hosts-file\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-kubelet-config\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837451    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837476    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cccrp\" (UniqueName: \"kubernetes.io/projected/561434f7-37d0-4656-a035-a9fad1e78bb4-kube-api-access-cccrp\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-script-lib\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837528    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysconfig\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837576    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4dp8\" (UniqueName: \"kubernetes.io/projected/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-kube-api-access-t4dp8\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525abf0e-50e6-41ab-a22e-9ae592828df6-konnectivity-ca\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.839574 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-netns\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-system-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525abf0e-50e6-41ab-a22e-9ae592828df6-agent-certs\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837802    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/455e7480-ef99-4293-a424-813302afc1ab-etc-sysconfig\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-ovn\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-run-netns\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837872    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-bin\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-netd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837908    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-run-ovn\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-bin\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.837993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2127d592-38b5-48ec-854b-628e49ea1bab-host-cni-netd\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.838179    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2127d592-38b5-48ec-854b-628e49ea1bab-ovnkube-script-lib\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.839149    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-tmp\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.839406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2127d592-38b5-48ec-854b-628e49ea1bab-ovn-node-metrics-cert\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.839872    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:38:54.840435 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.840003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/455e7480-ef99-4293-a424-813302afc1ab-etc-tuned\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.858597 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.858524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfl7p\" (UniqueName: \"kubernetes.io/projected/2127d592-38b5-48ec-854b-628e49ea1bab-kube-api-access-dfl7p\") pod \"ovnkube-node-n9zkq\" (UID: \"2127d592-38b5-48ec-854b-628e49ea1bab\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:54.860064 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.860039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cccrp\" (UniqueName: \"kubernetes.io/projected/561434f7-37d0-4656-a035-a9fad1e78bb4-kube-api-access-cccrp\") pod \"iptables-alerter-qz47z\" (UID: \"561434f7-37d0-4656-a035-a9fad1e78bb4\") " pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:54.862824 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.862801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lhx\" (UniqueName: \"kubernetes.io/projected/f4f57f74-43a1-4bcb-b9c3-6615e952fb66-kube-api-access-c4lhx\") pod \"node-ca-cr8vq\" (UID: \"f4f57f74-43a1-4bcb-b9c3-6615e952fb66\") " pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:54.863379 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.863364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77ccc\" (UniqueName: \"kubernetes.io/projected/455e7480-ef99-4293-a424-813302afc1ab-kube-api-access-77ccc\") pod \"tuned-c8zsh\" (UID: \"455e7480-ef99-4293-a424-813302afc1ab\") " pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:54.868494 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.868479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6qxn\" (UniqueName: \"kubernetes.io/projected/087625d7-5d88-4cb7-aa3f-6f9c2d900b9b-kube-api-access-w6qxn\") pod \"aws-ebs-csi-driver-node-njqvl\" (UID: \"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:54.938876 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-tmp-dir\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.938992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cni-binary-copy\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.938992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-daemon-config\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.938992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938924    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.938992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-conf-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.938992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.938976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-etc-kubernetes\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-kubelet\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-hostroot\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86979\" (UniqueName: \"kubernetes.io/projected/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-kube-api-access-86979\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-dbus\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939187    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-hostroot\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939231 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-etc-kubernetes\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-kubelet\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-k8s-cni-cncf-io\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-tmp-dir\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-netns\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-conf-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-k8s-cni-cncf-io\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-bin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-dbus\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939414    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-multus-certs\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpn2m\" (UniqueName: \"kubernetes.io/projected/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-kube-api-access-cpn2m\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939467    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-netns\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-multus\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939527    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-system-cni-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cnibin\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-bin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939575    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.939704 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-daemon-config\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.940293 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.940293 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-run-multus-certs\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.940293 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.939673    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-host-var-lib-cni-multus\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.940472 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cnibin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.940472 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cnibin\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.940472 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-hosts-file\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.940472 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.940472 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-kubelet-config\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940543    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-hosts-file\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4dp8\" (UniqueName: \"kubernetes.io/projected/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-kube-api-access-t4dp8\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-system-cni-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.940721 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.940684    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:54.941022 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.940801    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:38:55.44075276 +0000 UTC m=+2.120359517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:54.941022 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cni-binary-copy\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.941022 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525abf0e-50e6-41ab-a22e-9ae592828df6-konnectivity-ca\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.941022 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.940965    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-system-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.941022 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525abf0e-50e6-41ab-a22e-9ae592828df6-agent-certs\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.941277 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.941277 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.941277 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-socket-dir-parent\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.941277 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/525abf0e-50e6-41ab-a22e-9ae592828df6-konnectivity-ca\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.941504 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhqf\" (UniqueName: \"kubernetes.io/projected/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-kube-api-access-rvhqf\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:54.941504 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941397    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-multus-socket-dir-parent\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.941601 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-system-cni-dir\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.942244 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941861    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.942244 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.941985    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-cnibin\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.942244 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.942040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-cni-binary-copy\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.942244 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.942054    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5647f10-c7b0-4489-bec1-8e1613274f1c-kubelet-config\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:54.942244 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.942087    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:54.942561 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.942323    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:38:55.442187704 +0000 UTC m=+2.121794453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:54.944776 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.944752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/525abf0e-50e6-41ab-a22e-9ae592828df6-agent-certs\") pod \"konnectivity-agent-6dlfh\" (UID: \"525abf0e-50e6-41ab-a22e-9ae592828df6\") " pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:54.955769 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.955751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86979\" (UniqueName: \"kubernetes.io/projected/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-kube-api-access-86979\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:54.956684 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.956664    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:54.956684 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.956686    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:54.956786 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.956697    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:54.956786 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:54.956757    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:38:55.456743892 +0000 UTC m=+2.136350631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:54.959133 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.959111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4dp8\" (UniqueName: \"kubernetes.io/projected/a5079592-65f0-4ecc-b6fa-57ea9e4118cd-kube-api-access-t4dp8\") pod \"multus-jdqlv\" (UID: \"a5079592-65f0-4ecc-b6fa-57ea9e4118cd\") " pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:54.959614 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.959585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpn2m\" (UniqueName: \"kubernetes.io/projected/4fe3d781-ec0d-4a72-94d0-a48279ca2fe5-kube-api-access-cpn2m\") pod \"multus-additional-cni-plugins-t7kqm\" (UID: \"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5\") " pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:54.961467 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:54.961450    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhqf\" (UniqueName: \"kubernetes.io/projected/1af148d5-d1b5-4891-8e96-47ec18b6c7d2-kube-api-access-rvhqf\") pod \"node-resolver-mpll6\" (UID: \"1af148d5-d1b5-4891-8e96-47ec18b6c7d2\") " pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:55.053318 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.053198    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl"
Sep 17 15:38:55.058180 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.058164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jdqlv"
Sep 17 15:38:55.065302 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.065276    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087625d7_5d88_4cb7_aa3f_6f9c2d900b9b.slice/crio-9872769e064715f9ebc0a6e4727063bf3e79e163a37c2d9d10a0195aa8d05607 WatchSource:0}: Error finding container 9872769e064715f9ebc0a6e4727063bf3e79e163a37c2d9d10a0195aa8d05607: Status 404 returned error can't find the container with id 9872769e064715f9ebc0a6e4727063bf3e79e163a37c2d9d10a0195aa8d05607
Sep 17 15:38:55.068439 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.068420    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5079592_65f0_4ecc_b6fa_57ea9e4118cd.slice/crio-c6490a9d00520fab1de6e0047b62180ef8ace30427ff59a6b0d44518c7251d78 WatchSource:0}: Error finding container c6490a9d00520fab1de6e0047b62180ef8ace30427ff59a6b0d44518c7251d78: Status 404 returned error can't find the container with id c6490a9d00520fab1de6e0047b62180ef8ace30427ff59a6b0d44518c7251d78
Sep 17 15:38:55.074007 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.073988    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8zsh"
Sep 17 15:38:55.083615 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.083584    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455e7480_ef99_4293_a424_813302afc1ab.slice/crio-f232555d67f937be0e24f76d6d3d4b5d7757908af7f1387e80da515caea814c9 WatchSource:0}: Error finding container f232555d67f937be0e24f76d6d3d4b5d7757908af7f1387e80da515caea814c9: Status 404 returned error can't find the container with id f232555d67f937be0e24f76d6d3d4b5d7757908af7f1387e80da515caea814c9
Sep 17 15:38:55.091990 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.091968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cr8vq"
Sep 17 15:38:55.100646 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.100624    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f57f74_43a1_4bcb_b9c3_6615e952fb66.slice/crio-95176a10354f44bb45f9ad5c330db859b81fea8f5df8acc225851ad559b62f5d WatchSource:0}: Error finding container 95176a10354f44bb45f9ad5c330db859b81fea8f5df8acc225851ad559b62f5d: Status 404 returned error can't find the container with id 95176a10354f44bb45f9ad5c330db859b81fea8f5df8acc225851ad559b62f5d
Sep 17 15:38:55.112773 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.112752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qz47z"
Sep 17 15:38:55.121577 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.121557    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561434f7_37d0_4656_a035_a9fad1e78bb4.slice/crio-4459919b3a1aa7ae26c91fdddab2cfd0488b15532238d0774b3a66ecb76a3502 WatchSource:0}: Error finding container 4459919b3a1aa7ae26c91fdddab2cfd0488b15532238d0774b3a66ecb76a3502: Status 404 returned error can't find the container with id 4459919b3a1aa7ae26c91fdddab2cfd0488b15532238d0774b3a66ecb76a3502
Sep 17 15:38:55.141829 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.141806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:38:55.150076 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.150052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:38:55.150238 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.150217    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127d592_38b5_48ec_854b_628e49ea1bab.slice/crio-7f3b1a240bfce94c985654a6ac37efc98412d9e748cc12025eb572c153245349 WatchSource:0}: Error finding container 7f3b1a240bfce94c985654a6ac37efc98412d9e748cc12025eb572c153245349: Status 404 returned error can't find the container with id 7f3b1a240bfce94c985654a6ac37efc98412d9e748cc12025eb572c153245349
Sep 17 15:38:55.155493 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.155470    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mpll6"
Sep 17 15:38:55.158714 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.158631    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525abf0e_50e6_41ab_a22e_9ae592828df6.slice/crio-10bd255c6102a54c628f49bc471739cb2b8fa64b19145fe0ea3e4d51cc90611d WatchSource:0}: Error finding container 10bd255c6102a54c628f49bc471739cb2b8fa64b19145fe0ea3e4d51cc90611d: Status 404 returned error can't find the container with id 10bd255c6102a54c628f49bc471739cb2b8fa64b19145fe0ea3e4d51cc90611d
Sep 17 15:38:55.159368 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.159329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t7kqm"
Sep 17 15:38:55.164715 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.164689    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af148d5_d1b5_4891_8e96_47ec18b6c7d2.slice/crio-7446e68696749ee36e053bd50779acddc655c278e78ff9e40de0c27d75b6167a WatchSource:0}: Error finding container 7446e68696749ee36e053bd50779acddc655c278e78ff9e40de0c27d75b6167a: Status 404 returned error can't find the container with id 7446e68696749ee36e053bd50779acddc655c278e78ff9e40de0c27d75b6167a
Sep 17 15:38:55.169737 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:38:55.169715    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe3d781_ec0d_4a72_94d0_a48279ca2fe5.slice/crio-78ad5f17ba3226adfe04d9d8e1c1e3250ba591db6ac67cdc1365af934969f382 WatchSource:0}: Error finding container 78ad5f17ba3226adfe04d9d8e1c1e3250ba591db6ac67cdc1365af934969f382: Status 404 returned error can't find the container with id 78ad5f17ba3226adfe04d9d8e1c1e3250ba591db6ac67cdc1365af934969f382
Sep 17 15:38:55.256750 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.256718    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:55.319504 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.319430    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:55.445489 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.445450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:55.445699 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.445504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:55.445699 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.445632    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:55.445699 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.445644    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:55.445843 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.445710    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:38:56.445690553 +0000 UTC m=+3.125297303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:55.445843 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.445730    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:38:56.445719111 +0000 UTC m=+3.125325850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:55.546202 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.546158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:55.546395 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.546359    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:55.546395 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.546383    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:55.546395 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.546393    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:55.546577 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.546454    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:38:56.546439099 +0000 UTC m=+3.226045838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:55.800932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.800887    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:33:55 +0000 UTC" deadline="2028-06-21 09:57:09.58590005 +0000 UTC"
Sep 17 15:38:55.800932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.800929    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15426h18m13.784975907s"
Sep 17 15:38:55.833092 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.833056    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:55.833268 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:55.833216    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:38:55.869285 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.869038    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6dlfh" event={"ID":"525abf0e-50e6-41ab-a22e-9ae592828df6","Type":"ContainerStarted","Data":"10bd255c6102a54c628f49bc471739cb2b8fa64b19145fe0ea3e4d51cc90611d"}
Sep 17 15:38:55.874278 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.874241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qz47z" event={"ID":"561434f7-37d0-4656-a035-a9fad1e78bb4","Type":"ContainerStarted","Data":"4459919b3a1aa7ae26c91fdddab2cfd0488b15532238d0774b3a66ecb76a3502"}
Sep 17 15:38:55.899865 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.899677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal" event={"ID":"40c6e7c23f6418e0d386adbda44b2f29","Type":"ContainerStarted","Data":"408532bd63476e51397632d0d82e78e593cdfcb4f583952f3df7fc947781cb0d"}
Sep 17 15:38:55.915482 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.915429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerStarted","Data":"78ad5f17ba3226adfe04d9d8e1c1e3250ba591db6ac67cdc1365af934969f382"}
Sep 17 15:38:55.926633 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.926590    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpll6" event={"ID":"1af148d5-d1b5-4891-8e96-47ec18b6c7d2","Type":"ContainerStarted","Data":"7446e68696749ee36e053bd50779acddc655c278e78ff9e40de0c27d75b6167a"}
Sep 17 15:38:55.946799 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.946673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"7f3b1a240bfce94c985654a6ac37efc98412d9e748cc12025eb572c153245349"}
Sep 17 15:38:55.949388 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.948090    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:55.957691 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.957640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cr8vq" event={"ID":"f4f57f74-43a1-4bcb-b9c3-6615e952fb66","Type":"ContainerStarted","Data":"95176a10354f44bb45f9ad5c330db859b81fea8f5df8acc225851ad559b62f5d"}
Sep 17 15:38:55.989419 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:55.989372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8zsh" event={"ID":"455e7480-ef99-4293-a424-813302afc1ab","Type":"ContainerStarted","Data":"f232555d67f937be0e24f76d6d3d4b5d7757908af7f1387e80da515caea814c9"}
Sep 17 15:38:56.009565 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.009530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jdqlv" event={"ID":"a5079592-65f0-4ecc-b6fa-57ea9e4118cd","Type":"ContainerStarted","Data":"c6490a9d00520fab1de6e0047b62180ef8ace30427ff59a6b0d44518c7251d78"}
Sep 17 15:38:56.033528 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.033450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl" event={"ID":"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b","Type":"ContainerStarted","Data":"9872769e064715f9ebc0a6e4727063bf3e79e163a37c2d9d10a0195aa8d05607"}
Sep 17 15:38:56.053617 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.053490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal" event={"ID":"fa3e1f7a7e797a7c6cd70fdb40110517","Type":"ContainerStarted","Data":"8e6e345f88e3f6d40ff5971a6004fc61164cec50aacd30df80f792ce91989efe"}
Sep 17 15:38:56.453879 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.453837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:56.454078 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.453939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:56.454078 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.454034    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:56.454078 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.454050    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:56.454255 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.454128    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:38:58.45410696 +0000 UTC m=+5.133713714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:56.454255 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.454151    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:38:58.454139498 +0000 UTC m=+5.133746239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:56.555145 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.555103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:56.555374 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.555292    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:56.555374 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.555333    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:56.555374 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.555347    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:56.555556 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.555444    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:38:58.555422424 +0000 UTC m=+5.235029175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:56.801741 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.801665    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:33:55 +0000 UTC" deadline="2028-03-05 11:24:40.344064593 +0000 UTC"
Sep 17 15:38:56.801741 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.801728    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12835h45m43.542340734s"
Sep 17 15:38:56.830668 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.830634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:56.830855 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.830784    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:38:56.830855 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:56.830835    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:56.830981 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:56.830957    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:38:57.832762 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:57.832730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:57.833304 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:57.832879    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:58.471810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:58.471867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.471995    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.471998    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.472061    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:39:02.472041141 +0000 UTC m=+9.151647883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:58.472101 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.472081    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:39:02.472072053 +0000 UTC m=+9.151678789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:58.573409 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:58.572741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:58.573409 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.572933    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:58.573409 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.572957    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:58.573409 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.572971    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:58.573409 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.573029    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:02.57301057 +0000 UTC m=+9.252617330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:58.831400 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:58.831274    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:38:58.831556 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:58.831428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:38:58.831556 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.831437    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:38:58.831556 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:58.831505    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:38:59.830950 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:38:59.830406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:38:59.830950 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:38:59.830570    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:00.830552 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:00.830515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:00.830757 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:00.830663    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:00.830757 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:00.830708    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:00.830903 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:00.830791    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:01.832162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:01.830068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:01.832162 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:01.830229    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:02.514160 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:02.514057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:02.514160 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:02.514133    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:02.514415 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.514308    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:02.514415 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.514398    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:39:10.514377261 +0000 UTC m=+17.193984014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:02.514850 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.514812    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:02.514936 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.514869    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:39:10.514853998 +0000 UTC m=+17.194460739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:02.615488 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:02.615363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:02.615693 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.615536    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:39:02.615693 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.615567    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:39:02.615693 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.615581    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:02.615693 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.615649    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:10.615629356 +0000 UTC m=+17.295236106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:02.830440 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:02.830349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:02.830620 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.830493    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:02.830928 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:02.830901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:02.831046 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:02.831009    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:03.832226 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:03.832186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:03.832755 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:03.832301    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:04.830060 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:04.830024    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:04.830238 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:04.830160    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:04.830618 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:04.830600    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:04.830719 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:04.830691    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:05.830316 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:05.830202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:05.830773 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:05.830366    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:06.830282 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:06.830251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:06.830452 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:06.830373    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:06.830452 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:06.830437    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:06.830841 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:06.830545    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:07.830779 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:07.830752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:07.831080 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:07.830862    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:08.830634 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:08.830593    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:08.830634 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:08.830634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:08.831123 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:08.830738    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:08.831123 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:08.830853    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:09.830799 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:09.830761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:09.831253 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:09.830911    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:10.573894 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:10.573855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:10.573894 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:10.573901    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:10.574156 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.574023    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:10.574156 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.574027    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:10.574156 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.574094    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:39:26.574075826 +0000 UTC m=+33.253682583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:10.574156 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.574114    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:39:26.57410471 +0000 UTC m=+33.253711444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:10.674459 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:10.674416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:10.674609 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.674585    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:39:10.674609 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.674607    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:39:10.674714 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.674617    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:10.674714 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.674675    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:26.674659369 +0000 UTC m=+33.354266111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:10.830215 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:10.830128    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:10.830215 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:10.830160    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:10.830434 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.830259    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:10.830434 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:10.830391    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:11.830596 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:11.830563    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:11.831022 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:11.830697    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:12.830199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:12.830162    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:12.830199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:12.830184    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:12.830431 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:12.830295    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:12.830431 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:12.830415    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:13.831392 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:13.831357    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:13.831843 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:13.831483    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:14.829829 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:14.829798    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:14.829829 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:14.829843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:14.830083 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:14.829979    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:14.830131 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:14.830111    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:15.830178 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:15.829995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:15.830529 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:15.830318    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:16.132581 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.132216    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133037    2568 generic.go:356] "Generic (PLEG): container finished" podID="2127d592-38b5-48ec-854b-628e49ea1bab" containerID="628a571487d9fee71d55f8b8c286fa74827c9949276fbd04b264c5f3821ab708" exitCode=1
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"93cef5b3db538cb0b6082bbdd71e5fc20e621fff7133a180a75e1b64b210e55c"}
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"c75f33708c2f676de7a1687c6b5cea462f7fb059223c9d9360851d8a1ddf7f89"}
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"ab01df6acbdf9714a7308f37ed95cff3c4f7f20161ab951bfd821202fd94180e"}
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"a5dd10620af752151b7692e5202f3321daa2fb4a2b01201df354d566fa1f00ab"}
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerDied","Data":"628a571487d9fee71d55f8b8c286fa74827c9949276fbd04b264c5f3821ab708"}
Sep 17 15:39:16.133317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.133268    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"baad5a34d6e9fdf3bd7b16af89aa4032f6f84368246d7a89dc3adb1975fdfb57"}
Sep 17 15:39:16.146601 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.146567    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8zsh" event={"ID":"455e7480-ef99-4293-a424-813302afc1ab","Type":"ContainerStarted","Data":"e8184886fd644e358d1989d7c9f5cb5efa5297c8e55692df620c1fc5ff7fa89a"}
Sep 17 15:39:16.149525 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.149505    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jdqlv" event={"ID":"a5079592-65f0-4ecc-b6fa-57ea9e4118cd","Type":"ContainerStarted","Data":"7187d6c12fa3b42c6e44f3f00778b9b0453ae8f0b8c689ef3eb108080838c600"}
Sep 17 15:39:16.151759 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.151726    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal" event={"ID":"40c6e7c23f6418e0d386adbda44b2f29","Type":"ContainerStarted","Data":"2980eaaac869d8e73fbddab23ac9deb58d071ddf0c7cf97f367dae88f9a903fa"}
Sep 17 15:39:16.175324 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.174726    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c8zsh" podStartSLOduration=1.8877516239999999 podStartE2EDuration="22.174704834s" totalImagesPullingTime="20.28695321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:16.17383266 +0000 UTC m=+22.853439415" watchObservedRunningTime="2026-09-17 15:39:16.174704834 +0000 UTC m=+22.854311590"
Sep 17 15:39:16.200453 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.200353    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jdqlv" podStartSLOduration=1.345438342 podStartE2EDuration="22.200336586s" totalImagesPullingTime="20.854898244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:16.200012129 +0000 UTC m=+22.879618913" watchObservedRunningTime="2026-09-17 15:39:16.200336586 +0000 UTC m=+22.879943348"
Sep 17 15:39:16.223709 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.223662    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-116.ec2.internal" podStartSLOduration=21.223645559 podStartE2EDuration="21.223645559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:16.219765637 +0000 UTC m=+22.899372403" watchObservedRunningTime="2026-09-17 15:39:16.223645559 +0000 UTC m=+22.903252315"
Sep 17 15:39:16.829995 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.829967    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:16.830148 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:16.829968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:16.830148 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:16.830077    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:16.830994 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:16.830186    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:17.155916 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.155826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6dlfh" event={"ID":"525abf0e-50e6-41ab-a22e-9ae592828df6","Type":"ContainerStarted","Data":"14cd987e48e0c2e5c7959fe308938b9ad73221530ac291986caeed3344c2cda1"}
Sep 17 15:39:17.157442 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.157412    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qz47z" event={"ID":"561434f7-37d0-4656-a035-a9fad1e78bb4","Type":"ContainerStarted","Data":"e26e35a54e9a54581e2f1379f3cd45407d4aa4e8a9576d79109aa31586311fd4"}
Sep 17 15:39:17.158766 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.158740    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="a3219d8f457368e85af027e496bdb5def2e935c4e874e4eeaede262fe54d3811" exitCode=0
Sep 17 15:39:17.158867 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.158803    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"a3219d8f457368e85af027e496bdb5def2e935c4e874e4eeaede262fe54d3811"}
Sep 17 15:39:17.160552 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.160531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mpll6" event={"ID":"1af148d5-d1b5-4891-8e96-47ec18b6c7d2","Type":"ContainerStarted","Data":"bab37ba9c847a4fe408a923f659686eb757c73c8223ced661ad14afc2f5a3d07"}
Sep 17 15:39:17.164989 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.164968    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cr8vq" event={"ID":"f4f57f74-43a1-4bcb-b9c3-6615e952fb66","Type":"ContainerStarted","Data":"598cb4d0ebd47c7b56ee361550e17e3b1f083e4fb6b556711fd1639c52cc6ab6"}
Sep 17 15:39:17.166382 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.166363    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl" event={"ID":"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b","Type":"ContainerStarted","Data":"eab78d332d79689631e76d66adb787ca4fda1193e57fb3af01118550537a2a9c"}
Sep 17 15:39:17.167721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.167703    2568 generic.go:356] "Generic (PLEG): container finished" podID="fa3e1f7a7e797a7c6cd70fdb40110517" containerID="3d31b61f5b6ac45a411a714070fc4beb87d59ff92b357d732944b8ecbbf1c320" exitCode=0
Sep 17 15:39:17.167827 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.167804    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal" event={"ID":"fa3e1f7a7e797a7c6cd70fdb40110517","Type":"ContainerDied","Data":"3d31b61f5b6ac45a411a714070fc4beb87d59ff92b357d732944b8ecbbf1c320"}
Sep 17 15:39:17.176480 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.176445    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6dlfh" podStartSLOduration=10.573581852 podStartE2EDuration="23.176432983s" totalImagesPullingTime="12.602851131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:17.174640593 +0000 UTC m=+23.854247345" watchObservedRunningTime="2026-09-17 15:39:17.176432983 +0000 UTC m=+23.856039738"
Sep 17 15:39:17.287605 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.287439    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cr8vq" podStartSLOduration=3.381845578 podStartE2EDuration="23.287422994s" totalImagesPullingTime="19.905577416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:17.287177909 +0000 UTC m=+23.966784664" watchObservedRunningTime="2026-09-17 15:39:17.287422994 +0000 UTC m=+23.967029748"
Sep 17 15:39:17.310599 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.310559    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qz47z" podStartSLOduration=3.426748541 podStartE2EDuration="23.310544203s" totalImagesPullingTime="19.883795662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:17.310262228 +0000 UTC m=+23.989868996" watchObservedRunningTime="2026-09-17 15:39:17.310544203 +0000 UTC m=+23.990150972"
Sep 17 15:39:17.336654 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.335070    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mpll6" podStartSLOduration=3.130152735 podStartE2EDuration="23.335049927s" totalImagesPullingTime="20.204897192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:17.334349803 +0000 UTC m=+24.013956559" watchObservedRunningTime="2026-09-17 15:39:17.335049927 +0000 UTC m=+24.014656682"
Sep 17 15:39:17.616307 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.616259    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 15:39:17.806340 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.806186    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T15:39:17.616302898Z","UUID":"482d62e3-433b-4f58-a76b-ee0d757cb2ab","Handler":null,"Name":"","Endpoint":""}
Sep 17 15:39:17.807616 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.807597    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 15:39:17.807616 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.807628    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 15:39:17.830180 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:17.830154    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:17.830318 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:17.830295    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:18.172947 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:18.172898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl" event={"ID":"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b","Type":"ContainerStarted","Data":"7b2ca185fe26d1fed6d37ee94059e37b1c95c4a9c8570a4e9472c747f3861593"}
Sep 17 15:39:18.175239 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:18.175210    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal" event={"ID":"fa3e1f7a7e797a7c6cd70fdb40110517","Type":"ContainerStarted","Data":"3d5e30b42fbecc5395bba94e520bfe158366fae4a683ed6d90ccc8185abc10d1"}
Sep 17 15:39:18.222498 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:18.222446    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-116.ec2.internal" podStartSLOduration=23.222426149 podStartE2EDuration="23.222426149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:18.222203438 +0000 UTC m=+24.901810194" watchObservedRunningTime="2026-09-17 15:39:18.222426149 +0000 UTC m=+24.902032905"
Sep 17 15:39:18.829721 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:18.829691    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:18.829903 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:18.829715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:18.829903 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:18.829811    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:18.830014 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:18.829895    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:19.182197 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:19.182127    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:39:19.182653 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:19.182605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"26965d7beff697945bcf27a48abad4193afe0ff0429903fce7e3c92d82753ac2"}
Sep 17 15:39:19.185158 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:19.185133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl" event={"ID":"087625d7-5d88-4cb7-aa3f-6f9c2d900b9b","Type":"ContainerStarted","Data":"d1fe15a97d88a55e47264f6f004bdd99166f253f91fdc6ba719b20dcd1504e7f"}
Sep 17 15:39:19.829843 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:19.829810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:19.830025 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:19.829941    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:20.830529 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:20.830495    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:20.830987 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:20.830495    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:20.830987 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:20.830632    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:20.830987 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:20.830729    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:21.830750 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:21.830505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:21.831145 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:21.830861    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:21.862012 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:21.860990    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:39:21.862012 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:21.861944    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:39:21.882201 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:21.882163    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njqvl" podStartSLOduration=5.351213243 podStartE2EDuration="27.882149649s" totalImagesPullingTime="22.530936406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:19.226726198 +0000 UTC m=+25.906332954" watchObservedRunningTime="2026-09-17 15:39:21.882149649 +0000 UTC m=+28.561756447"
Sep 17 15:39:22.195138 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.195103    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="9d570afa3c5870dba209cbfed25b0b0f0c596230cfe2061a590ae6aca43d1392" exitCode=0
Sep 17 15:39:22.195317 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.195185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"9d570afa3c5870dba209cbfed25b0b0f0c596230cfe2061a590ae6aca43d1392"}
Sep 17 15:39:22.198842 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.198823    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:39:22.199255 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.199232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"ce8ceb9122d204c490121122eb6bf855ebc3872e91e3bba2f57b5c1566bea31a"}
Sep 17 15:39:22.199433 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.199414    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:39:22.199541 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.199454    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:22.199655 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.199641    2568 scope.go:117] "RemoveContainer" containerID="628a571487d9fee71d55f8b8c286fa74827c9949276fbd04b264c5f3821ab708"
Sep 17 15:39:22.199921 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.199904    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6dlfh"
Sep 17 15:39:22.829764 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.829730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:22.829901 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:22.829730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:22.829901 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:22.829871    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:22.830002 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:22.829930    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:23.204043 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.203997    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="125e34f7106e595f7c6096abbf97d1880f5d7aaadae44fceb1728287c3f18878" exitCode=0
Sep 17 15:39:23.204691 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.204082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"125e34f7106e595f7c6096abbf97d1880f5d7aaadae44fceb1728287c3f18878"}
Sep 17 15:39:23.210030 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.210013    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:39:23.210449 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.210420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" event={"ID":"2127d592-38b5-48ec-854b-628e49ea1bab","Type":"ContainerStarted","Data":"c21a015a79ed762568afc9132959cb4e0ed56645cda6743bbe8aa55a4ff4edee"}
Sep 17 15:39:23.210635 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.210614    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:23.210747 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.210691    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:23.226358 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.226335    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:23.226546 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.226532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:23.262847 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.262794    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq" podStartSLOduration=9.024435361 podStartE2EDuration="29.262781345s" totalImagesPullingTime="20.238345984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:23.26257915 +0000 UTC m=+29.942185907" watchObservedRunningTime="2026-09-17 15:39:23.262781345 +0000 UTC m=+29.942388125"
Sep 17 15:39:23.820216 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.820187    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgml8"]
Sep 17 15:39:23.820494 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.820336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:23.820494 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:23.820431    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:23.824507 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.824484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh8lz"]
Sep 17 15:39:23.824605 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.824581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:23.824685 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:23.824666    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:23.834539 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.834518    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cp9kh"]
Sep 17 15:39:23.834641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:23.834595    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:23.834691 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:23.834672    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:25.217338 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:25.217143    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="3c6ef11d2912ceb298456b540d115a2843c61e13578404f30aeb41025a7b6027" exitCode=0
Sep 17 15:39:25.217956 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:25.217215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"3c6ef11d2912ceb298456b540d115a2843c61e13578404f30aeb41025a7b6027"}
Sep 17 15:39:25.830007 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:25.829937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:25.830167 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:25.829937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:25.830167 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:25.830091    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:25.830167 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:25.829937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:25.830352 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:25.830170    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:25.830352 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:25.830216    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:26.591297 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:26.591243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:26.591703 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:26.591311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:26.591703 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.591397    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:26.591703 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.591412    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:26.591703 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.591465    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret podName:e5647f10-c7b0-4489-bec1-8e1613274f1c nodeName:}" failed. No retries permitted until 2026-09-17 15:39:58.591448468 +0000 UTC m=+65.271055214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret") pod "global-pull-secret-syncer-cp9kh" (UID: "e5647f10-c7b0-4489-bec1-8e1613274f1c") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:26.591703 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.591482    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:39:58.591475731 +0000 UTC m=+65.271082464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:26.692353 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:26.692320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:26.692537 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.692466    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:39:26.692537 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.692495    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:39:26.692537 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.692512    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gmtml for pod openshift-network-diagnostics/network-check-target-pgml8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:26.692705 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:26.692575    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml podName:f7f3419a-e3c5-454d-a120-c7a8843e6e6a nodeName:}" failed. No retries permitted until 2026-09-17 15:39:58.692557781 +0000 UTC m=+65.372164515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmtml" (UniqueName: "kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml") pod "network-check-target-pgml8" (UID: "f7f3419a-e3c5-454d-a120-c7a8843e6e6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:27.830803 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:27.830772    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:27.831377 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:27.830768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:27.831377 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:27.830781    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:27.831377 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:27.830899    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh8lz" podUID="1b5dfd7d-176e-47a5-ae63-b04602d0c58e"
Sep 17 15:39:27.831377 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:27.831058    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cp9kh" podUID="e5647f10-c7b0-4489-bec1-8e1613274f1c"
Sep 17 15:39:27.831377 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:27.831137    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgml8" podUID="f7f3419a-e3c5-454d-a120-c7a8843e6e6a"
Sep 17 15:39:28.597732 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.597697    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-116.ec2.internal" event="NodeReady"
Sep 17 15:39:28.597900 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.597866    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 15:39:28.663378 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.663289    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:39:28.697153 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.697121    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ph4t7"]
Sep 17 15:39:28.697346 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.697253    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.705864 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.705423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 15:39:28.705864 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.705426    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgfvz\""
Sep 17 15:39:28.705864 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.705474    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 15:39:28.706043 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.705936    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 15:39:28.715406 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.715374    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:39:28.715546 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.715419    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-66px2"]
Sep 17 15:39:28.715546 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.715500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.718003 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.717973    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 15:39:28.718630 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.718601    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 15:39:28.719187 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.719162    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fbs9\""
Sep 17 15:39:28.721233 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.721214    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 15:39:28.735347 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.735323    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ph4t7"]
Sep 17 15:39:28.735482 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.735447    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.736593 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.736574    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66px2"]
Sep 17 15:39:28.740162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.739926    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 15:39:28.740162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.739982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hgsvc\""
Sep 17 15:39:28.740717 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.740562    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 15:39:28.740983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.740962    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 15:39:28.808333 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac695afb-de8f-412a-971d-1659f018f784-cert\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.808526 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808349    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.808989 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808766    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.808989 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.808989 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d5qz\" (UniqueName: \"kubernetes.io/projected/ac695afb-de8f-412a-971d-1659f018f784-kube-api-access-4d5qz\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.809212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.808996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1932727-7741-4b70-91bb-8267396c5c53-config-volume\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.809212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.809041    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.809212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.809143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbrn\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.809212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.809208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758bv\" (UniqueName: \"kubernetes.io/projected/b1932727-7741-4b70-91bb-8267396c5c53-kube-api-access-758bv\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.809424 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.809243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.809424 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.809303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.811880 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.811855    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.811998 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.811902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.811998 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.811951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1932727-7741-4b70-91bb-8267396c5c53-tmp-dir\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.913062 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1932727-7741-4b70-91bb-8267396c5c53-tmp-dir\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913078    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac695afb-de8f-412a-971d-1659f018f784-cert\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d5qz\" (UniqueName: \"kubernetes.io/projected/ac695afb-de8f-412a-971d-1659f018f784-kube-api-access-4d5qz\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1932727-7741-4b70-91bb-8267396c5c53-config-volume\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbrn\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758bv\" (UniqueName: \"kubernetes.io/projected/b1932727-7741-4b70-91bb-8267396c5c53-kube-api-access-758bv\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.913604 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1932727-7741-4b70-91bb-8267396c5c53-tmp-dir\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.913615    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:28.913886    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:28.913947    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:29.413927868 +0000 UTC m=+36.093534614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.914040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.914157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b1932727-7741-4b70-91bb-8267396c5c53-config-volume\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:28.914237    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:28.914250    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:28.914414 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:28.914308    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:29.414296935 +0000 UTC m=+36.093903686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:28.914755 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.914668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.917978 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.917945    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.917978 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.917957    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.918485 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.918466    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac695afb-de8f-412a-971d-1659f018f784-cert\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:28.933874 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.933850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-758bv\" (UniqueName: \"kubernetes.io/projected/b1932727-7741-4b70-91bb-8267396c5c53-kube-api-access-758bv\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:28.934802 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.934781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbrn\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.937745 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.937703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:28.940222 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:28.940202    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d5qz\" (UniqueName: \"kubernetes.io/projected/ac695afb-de8f-412a-971d-1659f018f784-kube-api-access-4d5qz\") pod \"ingress-canary-66px2\" (UID: \"ac695afb-de8f-412a-971d-1659f018f784\") " pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:29.034331 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.034285    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:29.046133 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.046108    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-66px2"
Sep 17 15:39:29.148436 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.148397    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:29.417250 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.417211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:29.417456 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.417317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:29.417456 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:29.417388    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:29.417456 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:29.417408    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:29.417456 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:29.417427    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:29.417720 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:29.417467    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:30.41744896 +0000 UTC m=+37.097055721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:29.417720 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:29.417482    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:30.417475924 +0000 UTC m=+37.097082656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:29.558860 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.558782    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-66px2"]
Sep 17 15:39:29.563388 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:39:29.563232    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac695afb_de8f_412a_971d_1659f018f784.slice/crio-a29088bb1cf10fb51865d810c9ede72d5be7a88f1bc1e0cc608cdde4844f748a WatchSource:0}: Error finding container a29088bb1cf10fb51865d810c9ede72d5be7a88f1bc1e0cc608cdde4844f748a: Status 404 returned error can't find the container with id a29088bb1cf10fb51865d810c9ede72d5be7a88f1bc1e0cc608cdde4844f748a
Sep 17 15:39:29.829992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.829932    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:29.830101 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.829931    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:29.830101 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.830065    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:29.835848 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.835827    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:39:29.835848 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.835848    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:39:29.835986 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.835847    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7j2g9\""
Sep 17 15:39:29.836826 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.836801    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:39:29.836999 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.836979    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:39:29.837062 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:29.837040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddz86\""
Sep 17 15:39:30.229756 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:30.229725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66px2" event={"ID":"ac695afb-de8f-412a-971d-1659f018f784","Type":"ContainerStarted","Data":"a29088bb1cf10fb51865d810c9ede72d5be7a88f1bc1e0cc608cdde4844f748a"}
Sep 17 15:39:30.232951 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:30.232919    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="a00af1747a4cc275aafa9dc90e229a80aef3eaa854116ccd3b27fb77f72d9a6e" exitCode=0
Sep 17 15:39:30.233097 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:30.232994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"a00af1747a4cc275aafa9dc90e229a80aef3eaa854116ccd3b27fb77f72d9a6e"}
Sep 17 15:39:30.424696 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:30.424652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:30.424827 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:30.424737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:30.424827 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:30.424800    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:30.424827 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:30.424822    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:30.424959 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:30.424868    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:30.424959 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:30.424887    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:32.424865667 +0000 UTC m=+39.104472417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:30.424959 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:30.424904    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:32.424893803 +0000 UTC m=+39.104500536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:31.239735 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:31.239700    2568 generic.go:356] "Generic (PLEG): container finished" podID="4fe3d781-ec0d-4a72-94d0-a48279ca2fe5" containerID="5a480106a94429282d8c7d09c911fa18740db63d4fa44d1f08d964aa906a366b" exitCode=0
Sep 17 15:39:31.240258 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:31.239756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerDied","Data":"5a480106a94429282d8c7d09c911fa18740db63d4fa44d1f08d964aa906a366b"}
Sep 17 15:39:32.108996 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.108954    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:32.243452 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.243412    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-66px2" event={"ID":"ac695afb-de8f-412a-971d-1659f018f784","Type":"ContainerStarted","Data":"f1ceee845f9325a0158fe8156e98a85245721a45021a8507cb3ae05197b03b79"}
Sep 17 15:39:32.246821 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.246798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" event={"ID":"4fe3d781-ec0d-4a72-94d0-a48279ca2fe5","Type":"ContainerStarted","Data":"1084f6a442fd557e4112f18febebaf07e8d87c3d1ac3a956f6f3152b47c0abc5"}
Sep 17 15:39:32.264593 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.264554    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-66px2" podStartSLOduration=1.8685800160000001 podStartE2EDuration="4.264540747s" totalImagesPullingTime="2.395960731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:32.263980749 +0000 UTC m=+38.943587505" watchObservedRunningTime="2026-09-17 15:39:32.264540747 +0000 UTC m=+38.944147524"
Sep 17 15:39:32.303649 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.303512    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t7kqm" podStartSLOduration=7.268332771 podStartE2EDuration="38.303495094s" totalImagesPullingTime="31.035162323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:32.30192132 +0000 UTC m=+38.981528094" watchObservedRunningTime="2026-09-17 15:39:32.303495094 +0000 UTC m=+38.983101845"
Sep 17 15:39:32.445329 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.445295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:32.445489 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:32.445360    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:32.445489 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:32.445449    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:32.445489 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:32.445459    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:32.445489 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:32.445462    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:32.445613 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:32.445502    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:36.445489503 +0000 UTC m=+43.125096236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:32.445613 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:32.445525    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:36.445507197 +0000 UTC m=+43.125113943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:33.294224 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:33.294187    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:33.723677 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:33.723652    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:33.823451 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:33.823416    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:36.476898 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:36.476852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:36.476918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:36.477009    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:36.477015    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:36.477036    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:36.477061    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:44.477048613 +0000 UTC m=+51.156655347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:36.477346 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:36.477080    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:44.477067292 +0000 UTC m=+51.156674029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:37.092133 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:37.092100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:37.163781 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:37.163741    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:37.239981 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:37.239947    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:37.336707 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:37.336677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:38.092940 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:38.092908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:38.199027 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:38.198990    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:39.152060 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:39.152030    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:39.251120 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:39.251091    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:40.267091 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:40.265353    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:40.327932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:40.327901    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:41.364714 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:41.364685    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:43.054997 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:43.054969    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:43.118923 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:43.118884    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:44.537025 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:44.536984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:44.537053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:44.537157    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:44.537161    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:44.537245    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:00.537222564 +0000 UTC m=+67.216829297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:44.537170    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:39:44.537637 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:44.537345    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:00.537332261 +0000 UTC m=+67.216938994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:39:44.728266 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:44.728225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:44.795014 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:44.794926    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:49.420512 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:49.420479    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:49.478514 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:49.478480    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:51.163135 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:51.163100    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:51.244570 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:51.244523    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:54.595869 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:54.595826    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:54.659568 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:54.659528    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:55.234397 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:55.234373    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9zkq"
Sep 17 15:39:55.408466 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:55.408428    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:55.481151 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:55.481114    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:55.544939 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:55.544869    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:39:58.634812 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.634767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:58.634812 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.634823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:39:58.637470 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.637448    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:39:58.637659 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.637497    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:39:58.645203 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:58.645186    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 15:39:58.645312 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:39:58.645289    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs podName:1b5dfd7d-176e-47a5-ae63-b04602d0c58e nodeName:}" failed. No retries permitted until 2026-09-17 15:41:02.645250187 +0000 UTC m=+129.324856934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs") pod "network-metrics-daemon-gh8lz" (UID: "1b5dfd7d-176e-47a5-ae63-b04602d0c58e") : secret "metrics-daemon-secret" not found
Sep 17 15:39:58.648407 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.648381    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5647f10-c7b0-4489-bec1-8e1613274f1c-original-pull-secret\") pod \"global-pull-secret-syncer-cp9kh\" (UID: \"e5647f10-c7b0-4489-bec1-8e1613274f1c\") " pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:58.666785 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.666766    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cp9kh"
Sep 17 15:39:58.736114 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.736087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:58.739422 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.739394    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:39:58.749106 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.749086    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:39:58.759991 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.759971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtml\" (UniqueName: \"kubernetes.io/projected/f7f3419a-e3c5-454d-a120-c7a8843e6e6a-kube-api-access-gmtml\") pod \"network-check-target-pgml8\" (UID: \"f7f3419a-e3c5-454d-a120-c7a8843e6e6a\") " pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:58.949664 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.948114    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cp9kh"]
Sep 17 15:39:58.953611 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:39:58.953586    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5647f10_c7b0_4489_bec1_8e1613274f1c.slice/crio-f9e5f83bc26edb2f4132df9cdbb4a7a470728a8effe345b3a9bc41125c20fa91 WatchSource:0}: Error finding container f9e5f83bc26edb2f4132df9cdbb4a7a470728a8effe345b3a9bc41125c20fa91: Status 404 returned error can't find the container with id f9e5f83bc26edb2f4132df9cdbb4a7a470728a8effe345b3a9bc41125c20fa91
Sep 17 15:39:58.959608 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.959590    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7j2g9\""
Sep 17 15:39:58.967221 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:58.967196    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:39:59.236818 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:59.236789    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgml8"]
Sep 17 15:39:59.239629 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:39:59.239600    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f3419a_e3c5_454d_a120_c7a8843e6e6a.slice/crio-cb652259f0825ecdb83f2266dd819aa2e06c3d9b8336fd000460917ca9d3c743 WatchSource:0}: Error finding container cb652259f0825ecdb83f2266dd819aa2e06c3d9b8336fd000460917ca9d3c743: Status 404 returned error can't find the container with id cb652259f0825ecdb83f2266dd819aa2e06c3d9b8336fd000460917ca9d3c743
Sep 17 15:39:59.313957 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:59.313917    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgml8" event={"ID":"f7f3419a-e3c5-454d-a120-c7a8843e6e6a","Type":"ContainerStarted","Data":"cb652259f0825ecdb83f2266dd819aa2e06c3d9b8336fd000460917ca9d3c743"}
Sep 17 15:39:59.315312 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:39:59.315261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cp9kh" event={"ID":"e5647f10-c7b0-4489-bec1-8e1613274f1c","Type":"ContainerStarted","Data":"f9e5f83bc26edb2f4132df9cdbb4a7a470728a8effe345b3a9bc41125c20fa91"}
Sep 17 15:40:00.553260 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:00.553219    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:00.553317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:00.553411    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:00.553445    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:00.553456    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-789fdb764c-dg2sb: secret "image-registry-tls" not found
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:00.553496    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls podName:b1932727-7741-4b70-91bb-8267396c5c53 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:32.553474372 +0000 UTC m=+99.233081120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls") pod "dns-default-ph4t7" (UID: "b1932727-7741-4b70-91bb-8267396c5c53") : secret "dns-default-metrics-tls" not found
Sep 17 15:40:00.553729 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:00.553517    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls podName:f0c38484-2a81-422a-afd9-887deb09f132 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:32.55350773 +0000 UTC m=+99.233114472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls") pod "image-registry-789fdb764c-dg2sb" (UID: "f0c38484-2a81-422a-afd9-887deb09f132") : secret "image-registry-tls" not found
Sep 17 15:40:04.330848 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.330810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgml8" event={"ID":"f7f3419a-e3c5-454d-a120-c7a8843e6e6a","Type":"ContainerStarted","Data":"6011ccc7ef17f3e02efdf08e64d6490883e00bcbd50de8331495c7ff099cca85"}
Sep 17 15:40:04.331429 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.330940    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:40:04.332490 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.332460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cp9kh" event={"ID":"e5647f10-c7b0-4489-bec1-8e1613274f1c","Type":"ContainerStarted","Data":"87033696e13f4e66df64197209aa8cd648301a4b929e4de3e9b7f9a6f2576d3d"}
Sep 17 15:40:04.349455 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.349405    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pgml8" podStartSLOduration=65.434093805 podStartE2EDuration="1m10.349391422s" totalImagesPullingTime="4.915297617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:04.349140308 +0000 UTC m=+71.028747063" watchObservedRunningTime="2026-09-17 15:40:04.349391422 +0000 UTC m=+71.028998172"
Sep 17 15:40:04.371998 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.371942    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cp9kh" podStartSLOduration=64.179349784 podStartE2EDuration="1m9.371921297s" totalImagesPullingTime="5.192571513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:04.371375941 +0000 UTC m=+71.050982697" watchObservedRunningTime="2026-09-17 15:40:04.371921297 +0000 UTC m=+71.051528053"
Sep 17 15:40:04.706442 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.706402    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:04.770884 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:04.770856    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:13.650929 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.650888    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"]
Sep 17 15:40:13.652586 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.652566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"
Sep 17 15:40:13.655020 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.654996    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:40:13.655123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.654995    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5gpc9\""
Sep 17 15:40:13.655123 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.655040    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 15:40:13.667531 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.667510    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"]
Sep 17 15:40:13.750638 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.750593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2s48\" (UniqueName: \"kubernetes.io/projected/541469eb-433f-4128-8a32-b328cf2ce8aa-kube-api-access-z2s48\") pod \"volume-data-source-validator-86695b7cc7-f5qzl\" (UID: \"541469eb-433f-4128-8a32-b328cf2ce8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"
Sep 17 15:40:13.793346 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.793300    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:13.851788 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.851764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2s48\" (UniqueName: \"kubernetes.io/projected/541469eb-433f-4128-8a32-b328cf2ce8aa-kube-api-access-z2s48\") pod \"volume-data-source-validator-86695b7cc7-f5qzl\" (UID: \"541469eb-433f-4128-8a32-b328cf2ce8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"
Sep 17 15:40:13.862433 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.862400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2s48\" (UniqueName: \"kubernetes.io/projected/541469eb-433f-4128-8a32-b328cf2ce8aa-kube-api-access-z2s48\") pod \"volume-data-source-validator-86695b7cc7-f5qzl\" (UID: \"541469eb-433f-4128-8a32-b328cf2ce8aa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"
Sep 17 15:40:13.893904 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.893872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:13.961693 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:13.961612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"
Sep 17 15:40:14.232086 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:14.232058    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl"]
Sep 17 15:40:14.235789 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:14.235754    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541469eb_433f_4128_8a32_b328cf2ce8aa.slice/crio-992e187e0f5c6898fe92422f1679b5cc1fd25d9754bae42d8092c5a00ff52644 WatchSource:0}: Error finding container 992e187e0f5c6898fe92422f1679b5cc1fd25d9754bae42d8092c5a00ff52644: Status 404 returned error can't find the container with id 992e187e0f5c6898fe92422f1679b5cc1fd25d9754bae42d8092c5a00ff52644
Sep 17 15:40:14.357641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:14.357607    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl" event={"ID":"541469eb-433f-4128-8a32-b328cf2ce8aa","Type":"ContainerStarted","Data":"992e187e0f5c6898fe92422f1679b5cc1fd25d9754bae42d8092c5a00ff52644"}
Sep 17 15:40:15.144500 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.144466    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:15.253005 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.252970    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:15.349393 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.349361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:15.361622 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.361588    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl" event={"ID":"541469eb-433f-4128-8a32-b328cf2ce8aa","Type":"ContainerStarted","Data":"ad800731e9d32749797615b8df2c663e886d0b20772eace6cd8d0e5f2b9c4789"}
Sep 17 15:40:15.381862 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.381697    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-f5qzl" podStartSLOduration=1.493444688 podStartE2EDuration="2.381681804s" totalImagesPullingTime="888.237116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:15.381026354 +0000 UTC m=+82.060633114" watchObservedRunningTime="2026-09-17 15:40:15.381681804 +0000 UTC m=+82.061288571"
Sep 17 15:40:15.468987 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.468955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:15.530717 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:15.530689    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:17.712449 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:17.712420    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.151559 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.151532    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.207940 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.207908    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.372761 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.372728    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s9nhk"]
Sep 17 15:40:18.375841 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.375823    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.378064 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.378040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 15:40:18.378168 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.378154    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 15:40:18.378359 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.378336    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mv47d\""
Sep 17 15:40:18.378359 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.378362    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 15:40:18.378531 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.378378    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 15:40:18.390295 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.390262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s9nhk"]
Sep 17 15:40:18.396329 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.396304    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.486544 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.486514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.486667 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.486562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/882c93c6-325b-427e-abd5-69797a99f30c-crio-socket\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.486667 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.486655    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/882c93c6-325b-427e-abd5-69797a99f30c-data-volume\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.486772 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.486684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tsl\" (UniqueName: \"kubernetes.io/projected/882c93c6-325b-427e-abd5-69797a99f30c-kube-api-access-t5tsl\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.486772 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.486735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.544611 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.544566    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.587771 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/882c93c6-325b-427e-abd5-69797a99f30c-crio-socket\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.587891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/882c93c6-325b-427e-abd5-69797a99f30c-data-volume\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.587891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tsl\" (UniqueName: \"kubernetes.io/projected/882c93c6-325b-427e-abd5-69797a99f30c-kube-api-access-t5tsl\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.587891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.588033 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/882c93c6-325b-427e-abd5-69797a99f30c-crio-socket\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.588033 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.587908    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.588033 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:18.587973    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:18.588033 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:18.588018    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:18.588221 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:18.588055    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:19.088037369 +0000 UTC m=+85.767644122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:18.588221 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:18.588080    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:19.08806272 +0000 UTC m=+85.767669471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:18.588221 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.588138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/882c93c6-325b-427e-abd5-69797a99f30c-data-volume\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.602995 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.602972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tsl\" (UniqueName: \"kubernetes.io/projected/882c93c6-325b-427e-abd5-69797a99f30c-kube-api-access-t5tsl\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:18.649510 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.649488    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.668847 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.668822    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"]
Sep 17 15:40:18.671045 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.671032    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"
Sep 17 15:40:18.673997 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.673974    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 15:40:18.674110 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.674092    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 15:40:18.674181 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.674160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d462h\""
Sep 17 15:40:18.683642 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.683617    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"]
Sep 17 15:40:18.740978 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.740916    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.789940 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.789914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qhwn\" (UniqueName: \"kubernetes.io/projected/ced3b10f-e5e5-4f27-a49e-bf10e4c091e4-kube-api-access-5qhwn\") pod \"migrator-8b4d697c5-rg6bm\" (UID: \"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"
Sep 17 15:40:18.843120 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.843089    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:18.891247 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.891223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qhwn\" (UniqueName: \"kubernetes.io/projected/ced3b10f-e5e5-4f27-a49e-bf10e4c091e4-kube-api-access-5qhwn\") pod \"migrator-8b4d697c5-rg6bm\" (UID: \"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"
Sep 17 15:40:18.902061 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.902041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qhwn\" (UniqueName: \"kubernetes.io/projected/ced3b10f-e5e5-4f27-a49e-bf10e4c091e4-kube-api-access-5qhwn\") pod \"migrator-8b4d697c5-rg6bm\" (UID: \"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"
Sep 17 15:40:18.979621 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:18.979584    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"
Sep 17 15:40:19.098069 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:19.098023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:19.098069 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:19.098074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:19.098361 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:19.098143    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:19.098361 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:19.098155    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:19.098361 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:19.098203    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:20.098189909 +0000 UTC m=+86.777796643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:19.098361 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:19.098216    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:20.098209931 +0000 UTC m=+86.777816663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:19.249320 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:19.249267    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm"]
Sep 17 15:40:19.252172 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:19.252137    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced3b10f_e5e5_4f27_a49e_bf10e4c091e4.slice/crio-7717cca9b2c0b160da33ba5e8722e9b196f6aae73156562630c709f7a5ab7bdc WatchSource:0}: Error finding container 7717cca9b2c0b160da33ba5e8722e9b196f6aae73156562630c709f7a5ab7bdc: Status 404 returned error can't find the container with id 7717cca9b2c0b160da33ba5e8722e9b196f6aae73156562630c709f7a5ab7bdc
Sep 17 15:40:19.372950 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:19.372860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm" event={"ID":"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4","Type":"ContainerStarted","Data":"7717cca9b2c0b160da33ba5e8722e9b196f6aae73156562630c709f7a5ab7bdc"}
Sep 17 15:40:20.019343 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.019309    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-r6rd5"]
Sep 17 15:40:20.022185 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.022168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.024865 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.024841    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 15:40:20.025644 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.025615    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 15:40:20.025754 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.025661    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kpbmn\""
Sep 17 15:40:20.025754 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.025680    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 15:40:20.025754 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.025698    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 15:40:20.031712 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.031691    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-r6rd5"]
Sep 17 15:40:20.061382 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.061237    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:20.105751 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.105713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jmp\" (UniqueName: \"kubernetes.io/projected/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-kube-api-access-b2jmp\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.105932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.105797    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-cabundle\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.105932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.105879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:20.105932 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.105913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:20.106099 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.105945    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-key\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.106099 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:20.106022    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:20.106099 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:20.106041    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:20.106241 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:20.106112    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:22.10609041 +0000 UTC m=+88.785697157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:20.106241 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:20.106134    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:22.106124633 +0000 UTC m=+88.785731391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:20.165836 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.165801    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:20.207025 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.206992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-key\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.207175 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.207047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jmp\" (UniqueName: \"kubernetes.io/projected/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-kube-api-access-b2jmp\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.207175 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.207115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-cabundle\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.207742 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.207722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-cabundle\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.209653 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.209636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-signing-key\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.216746 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.216725    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jmp\" (UniqueName: \"kubernetes.io/projected/6a3af420-91ba-4ba6-9786-3c6b899ed9ce-kube-api-access-b2jmp\") pod \"service-ca-568869fdc5-r6rd5\" (UID: \"6a3af420-91ba-4ba6-9786-3c6b899ed9ce\") " pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.333615 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.333592    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-r6rd5"
Sep 17 15:40:20.378965 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.378938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm" event={"ID":"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4","Type":"ContainerStarted","Data":"6da4a4c1c006561da55be653499062a26c4b06bb7823839d01cbca8614e2eaac"}
Sep 17 15:40:20.379083 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.378995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm" event={"ID":"ced3b10f-e5e5-4f27-a49e-bf10e4c091e4","Type":"ContainerStarted","Data":"7bd0a54d2b5d5d9f828125de59a65899d290a148c9a288da4d864f494155e406"}
Sep 17 15:40:20.402344 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.402296    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rg6bm" podStartSLOduration=1.401750164 podStartE2EDuration="2.402260739s" totalImagesPullingTime="1.000510575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:20.400783311 +0000 UTC m=+87.080390057" watchObservedRunningTime="2026-09-17 15:40:20.402260739 +0000 UTC m=+87.081867552"
Sep 17 15:40:20.531906 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.531821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:20.548368 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.548339    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpll6_1af148d5-d1b5-4891-8e96-47ec18b6c7d2/dns-node-resolver/0.log"
Sep 17 15:40:20.598018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.597986    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:20.611196 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.611166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-r6rd5"]
Sep 17 15:40:20.614522 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:20.614501    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3af420_91ba_4ba6_9786_3c6b899ed9ce.slice/crio-b4b9f125fe021420dd278f18fcae978d75b199be0d5aff85c18a9bb11bdcc1ef WatchSource:0}: Error finding container b4b9f125fe021420dd278f18fcae978d75b199be0d5aff85c18a9bb11bdcc1ef: Status 404 returned error can't find the container with id b4b9f125fe021420dd278f18fcae978d75b199be0d5aff85c18a9bb11bdcc1ef
Sep 17 15:40:20.998068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:20.998038    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:21.347936 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:21.347863    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cr8vq_f4f57f74-43a1-4bcb-b9c3-6615e952fb66/node-ca/0.log"
Sep 17 15:40:21.383340 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:21.383305    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-r6rd5" event={"ID":"6a3af420-91ba-4ba6-9786-3c6b899ed9ce","Type":"ContainerStarted","Data":"b4b9f125fe021420dd278f18fcae978d75b199be0d5aff85c18a9bb11bdcc1ef"}
Sep 17 15:40:22.124174 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:22.124134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:22.124402 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:22.124190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:22.124402 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:22.124314    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:22.124402 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:22.124338    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:22.124402 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:22.124386    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:26.124369235 +0000 UTC m=+92.803975987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:22.124591 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:22.124413    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:26.124394701 +0000 UTC m=+92.804001449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:22.143631 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:22.143588    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66px2_ac695afb-de8f-412a-971d-1659f018f784/serve-healthcheck-canary/0.log"
Sep 17 15:40:23.308014 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:23.307971    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:23.392645 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:23.392603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-r6rd5" event={"ID":"6a3af420-91ba-4ba6-9786-3c6b899ed9ce","Type":"ContainerStarted","Data":"72d652b05b211a11c862f2024ec9e73a90d643a4dc109be6ace86a00889758a7"}
Sep 17 15:40:23.411367 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:23.411322    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-r6rd5" podStartSLOduration=1.5530098620000001 podStartE2EDuration="3.41130726s" totalImagesPullingTime="1.858297398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:23.410491969 +0000 UTC m=+90.090098723" watchObservedRunningTime="2026-09-17 15:40:23.41130726 +0000 UTC m=+90.090914015"
Sep 17 15:40:23.941298 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:23.941243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:24.183174 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:24.183134    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:24.282183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:24.282153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:24.342186 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:24.342148    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:24.429372 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:24.429341    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:24.643128 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:24.643037    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:25.648013 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:25.647974    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:25.844826 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:25.844790    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:26.155772 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:26.155730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:26.155970 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:26.155782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:26.155970 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:26.155860    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:26.155970 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:26.155873    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:26.155970 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:26.155929    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:34.15591207 +0000 UTC m=+100.835518807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:26.155970 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:26.155949    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls podName:882c93c6-325b-427e-abd5-69797a99f30c nodeName:}" failed. No retries permitted until 2026-09-17 15:40:34.15594132 +0000 UTC m=+100.835548062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9nhk" (UID: "882c93c6-325b-427e-abd5-69797a99f30c") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:26.242957 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:26.242918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:26.442869 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:26.442781    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:26.639583 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:26.639547    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:27.659812 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:27.659768    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:27.760347 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:27.760308    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:28.051524 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:28.051486    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:28.250362 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:28.250332    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:28.437158 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:28.437074    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:28.539062 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:28.539027    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:28.853454 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:28.853411    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:29.640027 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:29.639987    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:30.042739 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:30.042703    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:30.248013 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:30.247978    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:30.307206 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:30.307125    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:30.458474 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:30.458441    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:30.852199 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:30.852163    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:31.358424 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:31.358388    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:31.645646 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:31.645565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:31.850478 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:31.850444    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:32.248523 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.248492    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:32.447026 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.446994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:32.607831 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.607756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:32.607998 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.607846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:32.610384 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.610359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1932727-7741-4b70-91bb-8267396c5c53-metrics-tls\") pod \"dns-default-ph4t7\" (UID: \"b1932727-7741-4b70-91bb-8267396c5c53\") " pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:32.610485 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.610422    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"image-registry-789fdb764c-dg2sb\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") " pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:32.632265 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.629128    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fbs9\""
Sep 17 15:40:32.636403 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.636374    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:32.853622 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.853587    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:32.911178 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.911107    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kgfvz\""
Sep 17 15:40:32.917009 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.916981    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ph4t7"]
Sep 17 15:40:32.919885 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:32.919865    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:32.920583 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:32.920561    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1932727_7741_4b70_91bb_8267396c5c53.slice/crio-0b7c308da9b7a9c209c930b1ba7870ca9af582c35f2ebf1ff9ecb74adb0d55e8 WatchSource:0}: Error finding container 0b7c308da9b7a9c209c930b1ba7870ca9af582c35f2ebf1ff9ecb74adb0d55e8: Status 404 returned error can't find the container with id 0b7c308da9b7a9c209c930b1ba7870ca9af582c35f2ebf1ff9ecb74adb0d55e8
Sep 17 15:40:33.198591 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.198516    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:40:33.201504 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:33.201480    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c38484_2a81_422a_afd9_887deb09f132.slice/crio-41ecdefb64515bcd1030e0037a86007076e315edb5a4568d848183142bad29e5 WatchSource:0}: Error finding container 41ecdefb64515bcd1030e0037a86007076e315edb5a4568d848183142bad29e5: Status 404 returned error can't find the container with id 41ecdefb64515bcd1030e0037a86007076e315edb5a4568d848183142bad29e5
Sep 17 15:40:33.240161 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.240135    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:33.427387 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.427346    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" event={"ID":"f0c38484-2a81-422a-afd9-887deb09f132","Type":"ContainerStarted","Data":"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"}
Sep 17 15:40:33.427567 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.427405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" event={"ID":"f0c38484-2a81-422a-afd9-887deb09f132","Type":"ContainerStarted","Data":"41ecdefb64515bcd1030e0037a86007076e315edb5a4568d848183142bad29e5"}
Sep 17 15:40:33.427701 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.427648    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:33.429078 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.429053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ph4t7" event={"ID":"b1932727-7741-4b70-91bb-8267396c5c53","Type":"ContainerStarted","Data":"0b7c308da9b7a9c209c930b1ba7870ca9af582c35f2ebf1ff9ecb74adb0d55e8"}
Sep 17 15:40:33.449968 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.449890    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" podStartSLOduration=99.449875128 podStartE2EDuration="1m39.449875128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:33.44913946 +0000 UTC m=+100.128746217" watchObservedRunningTime="2026-09-17 15:40:33.449875128 +0000 UTC m=+100.129481873"
Sep 17 15:40:33.844693 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:33.844658    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:34.221149 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.221111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:34.221149 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.221154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:34.221791 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.221769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/882c93c6-325b-427e-abd5-69797a99f30c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:34.223891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.223866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/882c93c6-325b-427e-abd5-69797a99f30c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9nhk\" (UID: \"882c93c6-325b-427e-abd5-69797a99f30c\") " pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:34.245062 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.245035    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:34.284872 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.284831    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s9nhk"
Sep 17 15:40:34.449052 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.449013    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:34.645694 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.645659    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:34.821801 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:34.821736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s9nhk"]
Sep 17 15:40:34.824758 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:34.824731    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882c93c6_325b_427e_abd5_69797a99f30c.slice/crio-83abd9926cae319b6361415faa9e22e63cd8366dad5b1d3376b9e1e0ef2d1bd9 WatchSource:0}: Error finding container 83abd9926cae319b6361415faa9e22e63cd8366dad5b1d3376b9e1e0ef2d1bd9: Status 404 returned error can't find the container with id 83abd9926cae319b6361415faa9e22e63cd8366dad5b1d3376b9e1e0ef2d1bd9
Sep 17 15:40:35.337740 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.337711    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pgml8"
Sep 17 15:40:35.438699 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.438660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ph4t7" event={"ID":"b1932727-7741-4b70-91bb-8267396c5c53","Type":"ContainerStarted","Data":"b6a04e0bb87b1dbbf2a92c0fc4e5afb1e1b92a7cf7c47954feb3356ad2c86a5b"}
Sep 17 15:40:35.438878 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.438721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ph4t7" event={"ID":"b1932727-7741-4b70-91bb-8267396c5c53","Type":"ContainerStarted","Data":"a39cdc90f88ff23814b1a221a4f9731699bc25328af0db47e41852cfa39f6aaa"}
Sep 17 15:40:35.438878 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.438791    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:35.440104 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.440084    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9nhk" event={"ID":"882c93c6-325b-427e-abd5-69797a99f30c","Type":"ContainerStarted","Data":"ba8693db94fd613b2383a90f1d562f21a52496ca1cc7ed305effebcc7b24a610"}
Sep 17 15:40:35.440189 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.440123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9nhk" event={"ID":"882c93c6-325b-427e-abd5-69797a99f30c","Type":"ContainerStarted","Data":"83abd9926cae319b6361415faa9e22e63cd8366dad5b1d3376b9e1e0ef2d1bd9"}
Sep 17 15:40:35.461957 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:35.461910    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ph4t7" podStartSLOduration=65.789488119 podStartE2EDuration="1m7.461890303s" totalImagesPullingTime="1.672402184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:35.460249522 +0000 UTC m=+102.139856277" watchObservedRunningTime="2026-09-17 15:40:35.461890303 +0000 UTC m=+102.141497059"
Sep 17 15:40:36.448975 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:36.448935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9nhk" event={"ID":"882c93c6-325b-427e-abd5-69797a99f30c","Type":"ContainerStarted","Data":"681c556ffb6ce6330233f3160035ec9ab44d5768993035096339abc4c80f8055"}
Sep 17 15:40:37.454806 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:37.454721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9nhk" event={"ID":"882c93c6-325b-427e-abd5-69797a99f30c","Type":"ContainerStarted","Data":"ebd0fe47e482ca4263b4ebbd2ff482fa264370f2d7fa7cb4fa3b77b822e1de3b"}
Sep 17 15:40:37.480812 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:37.480763    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s9nhk" podStartSLOduration=17.215907368 podStartE2EDuration="19.480748261s" totalImagesPullingTime="2.264840893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:40:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:37.480429055 +0000 UTC m=+104.160035810" watchObservedRunningTime="2026-09-17 15:40:37.480748261 +0000 UTC m=+104.160355017"
Sep 17 15:40:40.262427 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:40.262385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:40.323470 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:40.323422    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:41.473032 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.472998    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"]
Sep 17 15:40:41.475740 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.475723    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.478977 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.478954    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 15:40:41.479099 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.478993    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 15:40:41.479099 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.478964    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 15:40:41.480785 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.480761    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 15:40:41.480917 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.480821    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 15:40:41.480917 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.480883    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 15:40:41.481026 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.480762    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 15:40:41.496203 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.496179    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"]
Sep 17 15:40:41.576032 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.575998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgpf\" (UniqueName: \"kubernetes.io/projected/1d7588bb-eeaf-48f8-b120-da6daf80a96e-kube-api-access-9sgpf\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.576183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.576044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7588bb-eeaf-48f8-b120-da6daf80a96e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.576183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.576064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.576183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.576154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.576183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.576182    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.576342 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.576200    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.673149 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.673119    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:41.677080 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgpf\" (UniqueName: \"kubernetes.io/projected/1d7588bb-eeaf-48f8-b120-da6daf80a96e-kube-api-access-9sgpf\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677166 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7588bb-eeaf-48f8-b120-da6daf80a96e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677166 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677166 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677311 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677311 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.677839 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.677797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7588bb-eeaf-48f8-b120-da6daf80a96e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.679844 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.679822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.679993 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.679974    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.680057 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.679976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-hub\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.680057 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.680014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d7588bb-eeaf-48f8-b120-da6daf80a96e-ca\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.696573 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.696541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgpf\" (UniqueName: \"kubernetes.io/projected/1d7588bb-eeaf-48f8-b120-da6daf80a96e-kube-api-access-9sgpf\") pod \"cluster-proxy-proxy-agent-689f4bd885-p8k75\" (UID: \"1d7588bb-eeaf-48f8-b120-da6daf80a96e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:41.769679 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.769605    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:41.795997 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:41.795966    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"
Sep 17 15:40:42.068812 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:42.068729    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75"]
Sep 17 15:40:42.072244 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:42.072223    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d7588bb_eeaf_48f8_b120_da6daf80a96e.slice/crio-5ddf5a08705bdb5b28b843b4e074450493b401710125d44b1e61988728479457 WatchSource:0}: Error finding container 5ddf5a08705bdb5b28b843b4e074450493b401710125d44b1e61988728479457: Status 404 returned error can't find the container with id 5ddf5a08705bdb5b28b843b4e074450493b401710125d44b1e61988728479457
Sep 17 15:40:42.472669 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:42.472635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75" event={"ID":"1d7588bb-eeaf-48f8-b120-da6daf80a96e","Type":"ContainerStarted","Data":"5ddf5a08705bdb5b28b843b4e074450493b401710125d44b1e61988728479457"}
Sep 17 15:40:44.318578 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:44.318540    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:44.382954 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:44.382918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:45.451659 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:45.451632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ph4t7"
Sep 17 15:40:47.918567 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:47.918522    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:48.023319 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:48.023258    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:48.123596 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:48.123565    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:48.438516 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:48.438483    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:51.174550 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:51.174509    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:51.251709 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:51.251678    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:51.636632 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:51.636600    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:52.923953 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:52.923916    2568 patch_prober.go:28] interesting pod/image-registry-789fdb764c-dg2sb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 15:40:52.924469 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:52.924003    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" podUID="f0c38484-2a81-422a-afd9-887deb09f132" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 15:40:53.837879 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:53.837773    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:54.438510 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:54.438483    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:40:54.658984 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:54.658954    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:54.724292 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:54.724225    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.355685 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.355651    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.580691 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.580646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.627372 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.627061    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ztrf2"]
Sep 17 15:40:55.630878 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.630859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.634071 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.633730    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 15:40:55.634071 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.633939    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 15:40:55.634071 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.633963    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 15:40:55.634071 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.634043    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 15:40:55.634379 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.634183    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 15:40:55.634379 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.633940    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 15:40:55.635063 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.634897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dl7rm\""
Sep 17 15:40:55.667536 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.667462    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.679411 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679411 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679397    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-sys\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-wtmp\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-textfile\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-root\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gcct\" (UniqueName: \"kubernetes.io/projected/39648581-1a0c-4ec2-9fcc-671c9519aec2-kube-api-access-2gcct\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679620 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-metrics-client-ca\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.679927 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.679627    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.772314 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.772207    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.780840 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-root\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.780840 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gcct\" (UniqueName: \"kubernetes.io/projected/39648581-1a0c-4ec2-9fcc-671c9519aec2-kube-api-access-2gcct\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-metrics-client-ca\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-root\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:55.780990    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-sys\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:40:55.781051    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls podName:39648581-1a0c-4ec2-9fcc-671c9519aec2 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:56.281032035 +0000 UTC m=+122.960638786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls") pod "node-exporter-ztrf2" (UID: "39648581-1a0c-4ec2-9fcc-671c9519aec2") : secret "node-exporter-tls" not found
Sep 17 15:40:55.781068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.780991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-sys\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781573 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-wtmp\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781927 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781680    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-wtmp\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781927 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-metrics-client-ca\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781927 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.781927 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-textfile\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.782181 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.781994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-textfile\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.784480 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.784457    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.802977 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.802949    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gcct\" (UniqueName: \"kubernetes.io/projected/39648581-1a0c-4ec2-9fcc-671c9519aec2-kube-api-access-2gcct\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:55.868058 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.868021    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:55.960891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:55.960857    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.061321 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.061267    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.195097 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.194994    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.287200 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.287158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:56.289668 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.289642    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39648581-1a0c-4ec2-9fcc-671c9519aec2-node-exporter-tls\") pod \"node-exporter-ztrf2\" (UID: \"39648581-1a0c-4ec2-9fcc-671c9519aec2\") " pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:56.474039 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.474009    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.520706 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.520671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75" event={"ID":"1d7588bb-eeaf-48f8-b120-da6daf80a96e","Type":"ContainerStarted","Data":"a63f4db6c06207ed1bffd0f75f44d0dd4e41f118861652159611b6abbbd43c19"}
Sep 17 15:40:56.520706 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.520712    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75" event={"ID":"1d7588bb-eeaf-48f8-b120-da6daf80a96e","Type":"ContainerStarted","Data":"9b915125c115b7ae2459235ee75ad9d266479d64c92ce6edc2fa83eebb6d62fb"}
Sep 17 15:40:56.520948 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.520724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75" event={"ID":"1d7588bb-eeaf-48f8-b120-da6daf80a96e","Type":"ContainerStarted","Data":"c76046e7a32e636c236c176457c8f9f3414bd2a9453ddd5580ffcec2146c23db"}
Sep 17 15:40:56.545437 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.545409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztrf2"
Sep 17 15:40:56.545826 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.545785    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-689f4bd885-p8k75" podStartSLOduration=1.734903734 podStartE2EDuration="15.545770807s" totalImagesPullingTime="13.810867073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:56.545094867 +0000 UTC m=+123.224701623" watchObservedRunningTime="2026-09-17 15:40:56.545770807 +0000 UTC m=+123.225377562"
Sep 17 15:40:56.556131 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:40:56.556105    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39648581_1a0c_4ec2_9fcc_671c9519aec2.slice/crio-a7a12778b2402f9ba8e624aeac775977674c68c19854f2f002ea0f82e64ae25f WatchSource:0}: Error finding container a7a12778b2402f9ba8e624aeac775977674c68c19854f2f002ea0f82e64ae25f: Status 404 returned error can't find the container with id a7a12778b2402f9ba8e624aeac775977674c68c19854f2f002ea0f82e64ae25f
Sep 17 15:40:56.613718 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.613683    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.723466 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.723425    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:56.823077 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:56.822993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:57.525776 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:57.525745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztrf2" event={"ID":"39648581-1a0c-4ec2-9fcc-671c9519aec2","Type":"ContainerStarted","Data":"379e7b8ce489031cbde8c132ad1fd843a10614d84b38a9f0b23bba024868490e"}
Sep 17 15:40:57.525941 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:57.525800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztrf2" event={"ID":"39648581-1a0c-4ec2-9fcc-671c9519aec2","Type":"ContainerStarted","Data":"a7a12778b2402f9ba8e624aeac775977674c68c19854f2f002ea0f82e64ae25f"}
Sep 17 15:40:58.529992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:58.529964    2568 generic.go:356] "Generic (PLEG): container finished" podID="39648581-1a0c-4ec2-9fcc-671c9519aec2" containerID="379e7b8ce489031cbde8c132ad1fd843a10614d84b38a9f0b23bba024868490e" exitCode=0
Sep 17 15:40:58.530455 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:58.530032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztrf2" event={"ID":"39648581-1a0c-4ec2-9fcc-671c9519aec2","Type":"ContainerDied","Data":"379e7b8ce489031cbde8c132ad1fd843a10614d84b38a9f0b23bba024868490e"}
Sep 17 15:40:58.634912 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:58.634867    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:58.738985 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:58.738952    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:58.963373 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:58.963291    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:59.055757 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:59.055728    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:40:59.536228 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:59.536191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztrf2" event={"ID":"39648581-1a0c-4ec2-9fcc-671c9519aec2","Type":"ContainerStarted","Data":"9cdd9c242f40b0241b9c48a96fec5d5dc1386e161d3d79b72568b42182cf1290"}
Sep 17 15:40:59.536598 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:59.536301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztrf2" event={"ID":"39648581-1a0c-4ec2-9fcc-671c9519aec2","Type":"ContainerStarted","Data":"e41edc22e1e1b0b5d59bc343d20d2850dbc0c2750c06ee88278de2d9382eb462"}
Sep 17 15:40:59.568334 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:40:59.568264    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ztrf2" podStartSLOduration=3.639979899 podStartE2EDuration="4.568249951s" totalImagesPullingTime="858.064617ms" totalInitContainerRuntime="70.205435ms" isStatefulPod=true podCreationTimestamp="2026-09-17 15:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:59.566966182 +0000 UTC m=+126.246572937" watchObservedRunningTime="2026-09-17 15:40:59.568249951 +0000 UTC m=+126.247856706"
Sep 17 15:41:00.394395 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:00.394354    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:00.760888 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:00.760855    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:01.963006 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:01.962964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:02.738974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:02.738938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:41:02.741413 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:02.741392    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b5dfd7d-176e-47a5-ae63-b04602d0c58e-metrics-certs\") pod \"network-metrics-daemon-gh8lz\" (UID: \"1b5dfd7d-176e-47a5-ae63-b04602d0c58e\") " pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:41:02.864268 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:02.864241    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddz86\""
Sep 17 15:41:02.872332 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:02.872314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh8lz"
Sep 17 15:41:03.154224 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:03.154094    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh8lz"]
Sep 17 15:41:03.158644 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:41:03.158620    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5dfd7d_176e_47a5_ae63_b04602d0c58e.slice/crio-832c150eb2a6e8869b6ae7c776d3b6c4b8cbc87542f54c726a3e25c4e47a75f5 WatchSource:0}: Error finding container 832c150eb2a6e8869b6ae7c776d3b6c4b8cbc87542f54c726a3e25c4e47a75f5: Status 404 returned error can't find the container with id 832c150eb2a6e8869b6ae7c776d3b6c4b8cbc87542f54c726a3e25c4e47a75f5
Sep 17 15:41:03.551547 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:03.551512    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh8lz" event={"ID":"1b5dfd7d-176e-47a5-ae63-b04602d0c58e","Type":"ContainerStarted","Data":"832c150eb2a6e8869b6ae7c776d3b6c4b8cbc87542f54c726a3e25c4e47a75f5"}
Sep 17 15:41:03.751599 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:03.751564    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:03.828467 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:03.828174    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:04.556702 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:04.556659    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh8lz" event={"ID":"1b5dfd7d-176e-47a5-ae63-b04602d0c58e","Type":"ContainerStarted","Data":"d4ba646270a4d7efc13fdcb1a889f07d3a0bb2e551ab572803ff2b25f96bcb25"}
Sep 17 15:41:04.557084 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:04.556730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh8lz" event={"ID":"1b5dfd7d-176e-47a5-ae63-b04602d0c58e","Type":"ContainerStarted","Data":"94578c04b254e32d956897722130894009922e12034405ed428cb71e70d11251"}
Sep 17 15:41:04.577918 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:04.577866    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gh8lz" podStartSLOduration=129.668011822 podStartE2EDuration="2m10.577850305s" totalImagesPullingTime="909.838483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:04.577101931 +0000 UTC m=+131.256708690" watchObservedRunningTime="2026-09-17 15:41:04.577850305 +0000 UTC m=+131.257457060"
Sep 17 15:41:04.687067 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:04.687024    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:04.751241 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:04.751206    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:05.251203 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:05.251172    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:41:05.346486 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:05.346453    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:05.410413 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:05.410375    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:06.388028 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:06.387992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:06.446011 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:06.445973    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:10.337100 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:10.337057    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:10.394716 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:10.394676    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:11.416991 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.416958    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-fgm92"]
Sep 17 15:41:11.420811 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.420795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:11.423130 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.423105    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 15:41:11.423383 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.423361    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 15:41:11.423491 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.423408    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qlfz4\""
Sep 17 15:41:11.423981 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.423927    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:11.434507 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.434486    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-fgm92"]
Sep 17 15:41:11.500464 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.500429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k27g\" (UniqueName: \"kubernetes.io/projected/49ff1b3f-5764-43c5-a159-d2df16a51515-kube-api-access-6k27g\") pod \"downloads-76f99584f4-fgm92\" (UID: \"49ff1b3f-5764-43c5-a159-d2df16a51515\") " pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:11.527326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.527295    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:11.600945 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.600918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k27g\" (UniqueName: \"kubernetes.io/projected/49ff1b3f-5764-43c5-a159-d2df16a51515-kube-api-access-6k27g\") pod \"downloads-76f99584f4-fgm92\" (UID: \"49ff1b3f-5764-43c5-a159-d2df16a51515\") " pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:11.610899 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.610875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k27g\" (UniqueName: \"kubernetes.io/projected/49ff1b3f-5764-43c5-a159-d2df16a51515-kube-api-access-6k27g\") pod \"downloads-76f99584f4-fgm92\" (UID: \"49ff1b3f-5764-43c5-a159-d2df16a51515\") " pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:11.729914 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.729888    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:11.734083 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:11.734057    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:12.005438 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.005355    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-fgm92"]
Sep 17 15:41:12.008530 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:41:12.008501    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ff1b3f_5764_43c5_a159_d2df16a51515.slice/crio-614ac73d3933816af4bcfe4d862e23216c54372121fa6ea23b6424b2cb5bc7e0 WatchSource:0}: Error finding container 614ac73d3933816af4bcfe4d862e23216c54372121fa6ea23b6424b2cb5bc7e0: Status 404 returned error can't find the container with id 614ac73d3933816af4bcfe4d862e23216c54372121fa6ea23b6424b2cb5bc7e0
Sep 17 15:41:12.097917 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.097880    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:12.163078 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.163042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:12.511558 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.511530    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:12.585204 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.585167    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:12.585827 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:12.585801    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-fgm92" event={"ID":"49ff1b3f-5764-43c5-a159-d2df16a51515","Type":"ContainerStarted","Data":"614ac73d3933816af4bcfe4d862e23216c54372121fa6ea23b6424b2cb5bc7e0"}
Sep 17 15:41:13.126416 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:13.126374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:13.311885 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:13.311785    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:13.728984 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:13.728938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:13.832955 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:13.832918    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:14.238447 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:14.238385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:15.977648 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:15.977594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:16.045226 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:16.045189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:16.154259 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:16.154211    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:16.221454 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:16.221407    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:18.181643 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:18.181602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:18.282311 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:18.282219    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:25.281541 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:25.281497    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:25.344913 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:25.344877    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:26.148493 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:26.148418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:27.542996 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:27.542917    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:27.609486 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:27.609444    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:28.648563 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:28.648524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-fgm92" event={"ID":"49ff1b3f-5764-43c5-a159-d2df16a51515","Type":"ContainerStarted","Data":"78f832b3a80a4d65b36de6dca2b52f26ca9f0f14dfe703138d6c824300fc6d18"}
Sep 17 15:41:28.648969 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:28.648739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:28.650139 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:28.650119    2568 patch_prober.go:28] interesting pod/downloads-76f99584f4-fgm92 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" start-of-body=
Sep 17 15:41:28.650196 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:28.650174    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-fgm92" podUID="49ff1b3f-5764-43c5-a159-d2df16a51515" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused"
Sep 17 15:41:28.675752 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:28.675706    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-fgm92" podStartSLOduration=1.249497958 podStartE2EDuration="17.675692822s" totalImagesPullingTime="16.426194864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:28.674248198 +0000 UTC m=+155.353854954" watchObservedRunningTime="2026-09-17 15:41:28.675692822 +0000 UTC m=+155.355299573"
Sep 17 15:41:29.670930 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:29.670895    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-fgm92"
Sep 17 15:41:29.966783 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:29.966692    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:29.985145 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:29.985111    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66px2_ac695afb-de8f-412a-971d-1659f018f784/serve-healthcheck-canary/0.log"
Sep 17 15:41:30.046260 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.046222    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:30.270662 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.270617    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" podUID="f0c38484-2a81-422a-afd9-887deb09f132" containerName="registry" containerID="cri-o://7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732" gracePeriod=30
Sep 17 15:41:30.541113 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.541084    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:41:30.659019 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.658980    2568 generic.go:356] "Generic (PLEG): container finished" podID="f0c38484-2a81-422a-afd9-887deb09f132" containerID="7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732" exitCode=0
Sep 17 15:41:30.659209 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.659041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb"
Sep 17 15:41:30.659209 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.659073    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" event={"ID":"f0c38484-2a81-422a-afd9-887deb09f132","Type":"ContainerDied","Data":"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"}
Sep 17 15:41:30.659209 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.659122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789fdb764c-dg2sb" event={"ID":"f0c38484-2a81-422a-afd9-887deb09f132","Type":"ContainerDied","Data":"41ecdefb64515bcd1030e0037a86007076e315edb5a4568d848183142bad29e5"}
Sep 17 15:41:30.659209 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.659153    2568 scope.go:117] "RemoveContainer" containerID="7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"
Sep 17 15:41:30.663191 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663164    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxbrn\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663335 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663335 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663335 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663324    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663509 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663349    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663509 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663379    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663509 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663405    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663509 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663440    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted\") pod \"f0c38484-2a81-422a-afd9-887deb09f132\" (UID: \"f0c38484-2a81-422a-afd9-887deb09f132\") "
Sep 17 15:41:30.663707 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663601    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:41:30.664705 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.663949    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:41:30.666586 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.666538    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:41:30.668296 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.667573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:41:30.668296 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.667627    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn" (OuterVolumeSpecName: "kube-api-access-gxbrn") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "kube-api-access-gxbrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:41:30.668296 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.667945    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:41:30.668296 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.668077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:41:30.674387 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.674360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f0c38484-2a81-422a-afd9-887deb09f132" (UID: "f0c38484-2a81-422a-afd9-887deb09f132"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:41:30.683010 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.682906    2568 scope.go:117] "RemoveContainer" containerID="7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"
Sep 17 15:41:30.683296 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:41:30.683254    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732\": container with ID starting with 7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732 not found: ID does not exist" containerID="7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"
Sep 17 15:41:30.683485 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.683450    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732"} err="failed to get container status \"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732\": rpc error: code = NotFound desc = could not find container \"7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732\": container with ID starting with 7ffafe1e85141f5e2add613456b4c6e1c77ca4ef55fe249ca056ca4596b96732 not found: ID does not exist"
Sep 17 15:41:30.764014 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.763976    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-bound-sa-token\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764014 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764008    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-registry-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764014 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764017    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-registry-certificates\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764031    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-image-registry-private-configuration\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764047    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0c38484-2a81-422a-afd9-887deb09f132-ca-trust-extracted\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764062    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxbrn\" (UniqueName: \"kubernetes.io/projected/f0c38484-2a81-422a-afd9-887deb09f132-kube-api-access-gxbrn\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764076    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0c38484-2a81-422a-afd9-887deb09f132-trusted-ca\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.764326 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.764089    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0c38484-2a81-422a-afd9-887deb09f132-installation-pull-secrets\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:41:30.924682 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.924605    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:30.984473 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.984442    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:41:30.990142 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:30.990118    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-789fdb764c-dg2sb"]
Sep 17 15:41:31.026614 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:31.026579    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:31.088054 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:31.088017    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:31.835811 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:31.835772    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c38484-2a81-422a-afd9-887deb09f132" path="/var/lib/kubelet/pods/f0c38484-2a81-422a-afd9-887deb09f132/volumes"
Sep 17 15:41:36.551685 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:36.551646    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:36.618051 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:36.618008    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:40.269478 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:40.269442    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:40.338491 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:40.338452    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:55.262141 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:55.262105    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:41:55.325315 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:41:55.325262    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:11.846197 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:11.846156    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:11.910799 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:11.910769    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:23.685248 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:23.685214    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:23.750743 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:23.750710    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:40.276731 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:40.276680    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:40.373125 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:40.373095    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:50.046748 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:50.046713    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:42:50.106062 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:42:50.106018    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:00.107191 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:00.107147    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:01.012287 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:01.012246    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:01.088001 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:01.087960    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:01.159488 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:01.159459    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:07.634502 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:07.634463    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:10.170950 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:10.170909    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:53.737833 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:53.737804    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:43:53.742440 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:53.742419    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:43:53.742570 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:53.742532    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 15:43:59.668257 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:59.668208    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:59.771831 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:59.771795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:43:59.948173 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:43:59.948088    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:00.712727 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.712693    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"]
Sep 17 15:44:00.713089 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.712931    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c38484-2a81-422a-afd9-887deb09f132" containerName="registry"
Sep 17 15:44:00.713089 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.712942    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c38484-2a81-422a-afd9-887deb09f132" containerName="registry"
Sep 17 15:44:00.713089 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.712989    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c38484-2a81-422a-afd9-887deb09f132" containerName="registry"
Sep 17 15:44:00.714810 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.714795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.717183 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.717167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 15:44:00.717289 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.717168    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 15:44:00.717686 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.717673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t29ks\""
Sep 17 15:44:00.726283 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.726249    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"]
Sep 17 15:44:00.805557 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.805527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.805557 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.805562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.805779 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.805604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79t8\" (UniqueName: \"kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.906293 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.906235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79t8\" (UniqueName: \"kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.906457 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.906318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.906457 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.906341    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.906670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.906655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.906711 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.906698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:00.916983 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:00.916955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79t8\" (UniqueName: \"kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:01.024072 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:01.024038    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:01.299909 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:01.299828    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"]
Sep 17 15:44:01.302884 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:44:01.302856    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75442a9_da9e_441d_bfef_5a5f985196d4.slice/crio-edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3 WatchSource:0}: Error finding container edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3: Status 404 returned error can't find the container with id edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3
Sep 17 15:44:01.304915 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:01.304895    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:44:02.165096 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:02.165058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5" event={"ID":"d75442a9-da9e-441d-bfef-5a5f985196d4","Type":"ContainerStarted","Data":"edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3"}
Sep 17 15:44:08.186674 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:08.186637    2568 generic.go:356] "Generic (PLEG): container finished" podID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerID="0a261c6144cbd2eb2b415b1009fdbee164137753d1098497279fddf71dcb6abb" exitCode=0
Sep 17 15:44:08.187052 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:08.186713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5" event={"ID":"d75442a9-da9e-441d-bfef-5a5f985196d4","Type":"ContainerDied","Data":"0a261c6144cbd2eb2b415b1009fdbee164137753d1098497279fddf71dcb6abb"}
Sep 17 15:44:11.201957 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:11.201920    2568 generic.go:356] "Generic (PLEG): container finished" podID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerID="596c4509519e973b4f53b9832c7bc74a0fb3f276b50a688acf215d841ed3d962" exitCode=0
Sep 17 15:44:11.202423 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:11.202004    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5" event={"ID":"d75442a9-da9e-441d-bfef-5a5f985196d4","Type":"ContainerDied","Data":"596c4509519e973b4f53b9832c7bc74a0fb3f276b50a688acf215d841ed3d962"}
Sep 17 15:44:17.291032 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:17.290985    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:17.389771 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:17.389733    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:18.231021 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:18.230985    2568 generic.go:356] "Generic (PLEG): container finished" podID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerID="ec9486e842cdae124c7c9395afa478102bc09223206fab2d99c896048c9b30e4" exitCode=0
Sep 17 15:44:18.231191 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:18.231081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5" event={"ID":"d75442a9-da9e-441d-bfef-5a5f985196d4","Type":"ContainerDied","Data":"ec9486e842cdae124c7c9395afa478102bc09223206fab2d99c896048c9b30e4"}
Sep 17 15:44:19.355454 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.355431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:19.436003 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.435967    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util\") pod \"d75442a9-da9e-441d-bfef-5a5f985196d4\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") "
Sep 17 15:44:19.436003 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.436013    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle\") pod \"d75442a9-da9e-441d-bfef-5a5f985196d4\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") "
Sep 17 15:44:19.436212 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.436038    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b79t8\" (UniqueName: \"kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8\") pod \"d75442a9-da9e-441d-bfef-5a5f985196d4\" (UID: \"d75442a9-da9e-441d-bfef-5a5f985196d4\") "
Sep 17 15:44:19.436841 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.436813    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle" (OuterVolumeSpecName: "bundle") pod "d75442a9-da9e-441d-bfef-5a5f985196d4" (UID: "d75442a9-da9e-441d-bfef-5a5f985196d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:44:19.438420 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.438392    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8" (OuterVolumeSpecName: "kube-api-access-b79t8") pod "d75442a9-da9e-441d-bfef-5a5f985196d4" (UID: "d75442a9-da9e-441d-bfef-5a5f985196d4"). InnerVolumeSpecName "kube-api-access-b79t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:44:19.440837 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.440818    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util" (OuterVolumeSpecName: "util") pod "d75442a9-da9e-441d-bfef-5a5f985196d4" (UID: "d75442a9-da9e-441d-bfef-5a5f985196d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:44:19.536852 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.536750    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-util\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:44:19.536852 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.536795    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d75442a9-da9e-441d-bfef-5a5f985196d4-bundle\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:44:19.536852 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:19.536803    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b79t8\" (UniqueName: \"kubernetes.io/projected/d75442a9-da9e-441d-bfef-5a5f985196d4-kube-api-access-b79t8\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:44:20.240221 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:20.240182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5" event={"ID":"d75442a9-da9e-441d-bfef-5a5f985196d4","Type":"ContainerDied","Data":"edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3"}
Sep 17 15:44:20.240416 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:20.240222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtdn5"
Sep 17 15:44:20.240416 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:20.240237    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edef0a36c85ab4df2cd31ec76c4421aefac460cd400a58351cdcd6370979dab3"
Sep 17 15:44:21.861993 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:21.861957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:21.959390 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:21.959355    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:24.304941 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.304907    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"]
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305167    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="pull"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305176    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="pull"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305184    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="extract"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305189    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="extract"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305197    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="util"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305203    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="util"
Sep 17 15:44:24.305369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.305244    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d75442a9-da9e-441d-bfef-5a5f985196d4" containerName="extract"
Sep 17 15:44:24.348896 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.348866    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"]
Sep 17 15:44:24.349045 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.348962    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.351451 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.351431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 15:44:24.351986 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.351969    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-jrt85\""
Sep 17 15:44:24.352135 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.352120    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 15:44:24.352483 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.352470    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 15:44:24.371081 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.371062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/bc2c0618-847d-40c4-9336-6c8f0b13fc75-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.371180 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.371110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqw7m\" (UniqueName: \"kubernetes.io/projected/bc2c0618-847d-40c4-9336-6c8f0b13fc75-kube-api-access-xqw7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.472306 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.472261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/bc2c0618-847d-40c4-9336-6c8f0b13fc75-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.472493 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.472328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqw7m\" (UniqueName: \"kubernetes.io/projected/bc2c0618-847d-40c4-9336-6c8f0b13fc75-kube-api-access-xqw7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.474798 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.474774    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/bc2c0618-847d-40c4-9336-6c8f0b13fc75-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.483553 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.483532    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqw7m\" (UniqueName: \"kubernetes.io/projected/bc2c0618-847d-40c4-9336-6c8f0b13fc75-kube-api-access-xqw7m\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-rlrcq\" (UID: \"bc2c0618-847d-40c4-9336-6c8f0b13fc75\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.658547 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.658462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:24.958017 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:24.957936    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"]
Sep 17 15:44:24.962914 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:44:24.962877    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2c0618_847d_40c4_9336_6c8f0b13fc75.slice/crio-0fcbf2f2882a40debe0d440b2acacac04d8b2aba5200167bde1f5e2ff3ea3b77 WatchSource:0}: Error finding container 0fcbf2f2882a40debe0d440b2acacac04d8b2aba5200167bde1f5e2ff3ea3b77: Status 404 returned error can't find the container with id 0fcbf2f2882a40debe0d440b2acacac04d8b2aba5200167bde1f5e2ff3ea3b77
Sep 17 15:44:25.258461 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:25.258429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq" event={"ID":"bc2c0618-847d-40c4-9336-6c8f0b13fc75","Type":"ContainerStarted","Data":"0fcbf2f2882a40debe0d440b2acacac04d8b2aba5200167bde1f5e2ff3ea3b77"}
Sep 17 15:44:28.272816 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:28.272721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq" event={"ID":"bc2c0618-847d-40c4-9336-6c8f0b13fc75","Type":"ContainerStarted","Data":"4d1ee953ad462f5f6df8dbecfa4712418080e07a90d01920d610e4d449bccb8e"}
Sep 17 15:44:28.273177 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:28.272851    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:28.301760 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:28.301706    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq" podStartSLOduration=1.267116913 podStartE2EDuration="4.301692275s" totalImagesPullingTime="3.034575362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:44:28.300396847 +0000 UTC m=+334.980003596" watchObservedRunningTime="2026-09-17 15:44:28.301692275 +0000 UTC m=+334.981299030"
Sep 17 15:44:28.563479 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:28.563395    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:28.942919 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:28.942821    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:29.661490 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.661453    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:29.757781 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.757750    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:29.826791 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.826752    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"]
Sep 17 15:44:29.828670 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.828654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:29.831331 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.831305    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 17 15:44:29.831565 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.831545    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8jmgk\""
Sep 17 15:44:29.832021 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.832001    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 17 15:44:29.841452 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.841429    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"]
Sep 17 15:44:29.909718 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.909686    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:29.912616 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.912553    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8brht\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-kube-api-access-8brht\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:29.912616 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.912581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1126d6c7-63c9-4356-ba1b-d44f32569890-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:29.912796 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:29.912625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.014118 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.014080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8brht\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-kube-api-access-8brht\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.014299 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.014128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1126d6c7-63c9-4356-ba1b-d44f32569890-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.014299 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.014179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.014546 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.014528    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1126d6c7-63c9-4356-ba1b-d44f32569890-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.016888 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.016865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.027444 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.027420    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8brht\" (UniqueName: \"kubernetes.io/projected/1126d6c7-63c9-4356-ba1b-d44f32569890-kube-api-access-8brht\") pod \"keda-metrics-apiserver-77857b7b98-rjlzx\" (UID: \"1126d6c7-63c9-4356-ba1b-d44f32569890\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.048082 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.048053    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.062693 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.062669    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-vwjbp"]
Sep 17 15:44:30.065247 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.065229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.068116 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:44:30.068087    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"keda-admission-6c4d864b86-vwjbp\" is forbidden: User \"system:node:ip-10-0-128-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-116.ec2.internal' and this object" podUID="b0ec79a0-a476-470e-a34f-6cc468cbabce" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.068602 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:44:30.068575    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keda-admission-webhooks-certs\" is forbidden: User \"system:node:ip-10-0-128-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" type="*v1.Secret"
Sep 17 15:44:30.083501 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.083435    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-vwjbp"]
Sep 17 15:44:30.114613 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.114584    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m42c2\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-kube-api-access-m42c2\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.114764 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.114672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.140105 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.140074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:30.153337 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.153302    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.215298 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.215251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.215455 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.215315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m42c2\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-kube-api-access-m42c2\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.227262 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.227237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m42c2\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-kube-api-access-m42c2\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:30.251337 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.251303    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.412738 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.412700    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"]
Sep 17 15:44:30.415379 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:44:30.415354    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1126d6c7_63c9_4356_ba1b_d44f32569890.slice/crio-1284e589f1867b85b78c3e0e6e8e375f2fd954b98db3f9406b376b929845f58d WatchSource:0}: Error finding container 1284e589f1867b85b78c3e0e6e8e375f2fd954b98db3f9406b376b929845f58d: Status 404 returned error can't find the container with id 1284e589f1867b85b78c3e0e6e8e375f2fd954b98db3f9406b376b929845f58d
Sep 17 15:44:30.489107 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.489072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.685875 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.685840    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.881387 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.881305    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:30.982858 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:30.982813    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:44:31.216223 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:44:31.216138    2568 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: failed to sync secret cache: timed out waiting for the condition
Sep 17 15:44:31.216223 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:44:31.216178    2568 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-6c4d864b86-vwjbp: failed to sync secret cache: timed out waiting for the condition
Sep 17 15:44:31.216486 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:44:31.216254    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates podName:b0ec79a0-a476-470e-a34f-6cc468cbabce nodeName:}" failed. No retries permitted until 2026-09-17 15:44:31.716233933 +0000 UTC m=+338.395840666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates") pod "keda-admission-6c4d864b86-vwjbp" (UID: "b0ec79a0-a476-470e-a34f-6cc468cbabce") : failed to sync secret cache: timed out waiting for the condition
Sep 17 15:44:31.284630 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:31.284593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx" event={"ID":"1126d6c7-63c9-4356-ba1b-d44f32569890","Type":"ContainerStarted","Data":"1284e589f1867b85b78c3e0e6e8e375f2fd954b98db3f9406b376b929845f58d"}
Sep 17 15:44:31.514855 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:31.514824    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Sep 17 15:44:31.728453 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:31.728417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:31.731741 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:31.731718    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b0ec79a0-a476-470e-a34f-6cc468cbabce-certificates\") pod \"keda-admission-6c4d864b86-vwjbp\" (UID: \"b0ec79a0-a476-470e-a34f-6cc468cbabce\") " pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:31.876106 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:31.876017    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:32.156486 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:32.156405    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-vwjbp"]
Sep 17 15:44:32.160048 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:44:32.160023    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ec79a0_a476_470e_a34f_6cc468cbabce.slice/crio-b21eb4aa700a1f8f601104c92018a6e27047599351d30467c7116a071bfa6aae WatchSource:0}: Error finding container b21eb4aa700a1f8f601104c92018a6e27047599351d30467c7116a071bfa6aae: Status 404 returned error can't find the container with id b21eb4aa700a1f8f601104c92018a6e27047599351d30467c7116a071bfa6aae
Sep 17 15:44:32.290463 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:32.290425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp" event={"ID":"b0ec79a0-a476-470e-a34f-6cc468cbabce","Type":"ContainerStarted","Data":"b21eb4aa700a1f8f601104c92018a6e27047599351d30467c7116a071bfa6aae"}
Sep 17 15:44:33.296690 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:33.296649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx" event={"ID":"1126d6c7-63c9-4356-ba1b-d44f32569890","Type":"ContainerStarted","Data":"87dfdff0d5c45c225482b9e62c5d9cc4909c3ab7ca17cbffecdf64954a86748a"}
Sep 17 15:44:33.297106 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:33.296810    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:33.315955 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:33.315898    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx" podStartSLOduration=1.5787785460000001 podStartE2EDuration="4.315883864s" totalImagesPullingTime="2.737105318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:44:33.315421642 +0000 UTC m=+339.995028400" watchObservedRunningTime="2026-09-17 15:44:33.315883864 +0000 UTC m=+339.995490619"
Sep 17 15:44:34.303942 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:34.303870    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp" event={"ID":"b0ec79a0-a476-470e-a34f-6cc468cbabce","Type":"ContainerStarted","Data":"44a3b268dde10898a9db02051407a108bc8c80639844f9b2c4ae6e580e4d5d4a"}
Sep 17 15:44:34.304363 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:34.304072    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:44:34.326298 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:34.326235    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp" podStartSLOduration=2.531192895 podStartE2EDuration="4.32621753s" totalImagesPullingTime="1.795024635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:44:34.324765979 +0000 UTC m=+341.004372733" watchObservedRunningTime="2026-09-17 15:44:34.32621753 +0000 UTC m=+341.005824286"
Sep 17 15:44:44.308475 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:44.308444    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rjlzx"
Sep 17 15:44:49.278832 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:49.278802    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-rlrcq"
Sep 17 15:44:55.311545 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:44:55.311515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-vwjbp"
Sep 17 15:45:20.984619 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:20.984573    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:23.160832 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:23.160789    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.213687 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.213647    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.316900 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.316862    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.363134 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.363100    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"]
Sep 17 15:45:51.366391 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.366372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.370979 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.370956    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 15:45:51.373863 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.373835    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-hp5b7\""
Sep 17 15:45:51.374164 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.374146    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 15:45:51.374259 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.374182    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 15:45:51.389595 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.389569    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"]
Sep 17 15:45:51.410530 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.410506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhmkt\" (UniqueName: \"kubernetes.io/projected/c4813062-3df1-4577-b077-654ceffc8ffc-kube-api-access-mhmkt\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.410654 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.410561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4813062-3df1-4577-b077-654ceffc8ffc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.421039 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.421010    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.501972 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.501942    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.511369 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.511343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4813062-3df1-4577-b077-654ceffc8ffc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.511470 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.511384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhmkt\" (UniqueName: \"kubernetes.io/projected/c4813062-3df1-4577-b077-654ceffc8ffc-kube-api-access-mhmkt\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.514068 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.514047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4813062-3df1-4577-b077-654ceffc8ffc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.522463 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.522437    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhmkt\" (UniqueName: \"kubernetes.io/projected/c4813062-3df1-4577-b077-654ceffc8ffc-kube-api-access-mhmkt\") pod \"llmisvc-controller-manager-645f9c8fd6-nsbc4\" (UID: \"c4813062-3df1-4577-b077-654ceffc8ffc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.673039 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.673012    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:51.677875 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.677859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:51.950644 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:51.950567    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"]
Sep 17 15:45:51.954255 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:45:51.954229    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc4813062_3df1_4577_b077_654ceffc8ffc.slice/crio-a7713f789252f36c5d6aad02891d7a5ef20c8e13fd1e8fb0fc597ca113d2a365 WatchSource:0}: Error finding container a7713f789252f36c5d6aad02891d7a5ef20c8e13fd1e8fb0fc597ca113d2a365: Status 404 returned error can't find the container with id a7713f789252f36c5d6aad02891d7a5ef20c8e13fd1e8fb0fc597ca113d2a365
Sep 17 15:45:52.597892 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:52.597815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4" event={"ID":"c4813062-3df1-4577-b077-654ceffc8ffc","Type":"ContainerStarted","Data":"a7713f789252f36c5d6aad02891d7a5ef20c8e13fd1e8fb0fc597ca113d2a365"}
Sep 17 15:45:52.821582 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:52.821543    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:52.922309 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:52.922184    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:45:54.607507 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:54.607414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4" event={"ID":"c4813062-3df1-4577-b077-654ceffc8ffc","Type":"ContainerStarted","Data":"3627c0ca3258243a2fa1745700afc3d38880f0545d3cda5dc198428ca9986dfe"}
Sep 17 15:45:54.607883 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:54.607549    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:45:54.627936 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:45:54.627885    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4" podStartSLOduration=1.244964097 podStartE2EDuration="3.627870095s" totalImagesPullingTime="2.382905998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:45:54.627115574 +0000 UTC m=+421.306722328" watchObservedRunningTime="2026-09-17 15:45:54.627870095 +0000 UTC m=+421.307476905"
Sep 17 15:46:20.658858 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:20.658777    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:24.042324 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:24.042267    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:24.913856 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:24.913814    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:24.972041 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:24.972010    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:25.613974 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:25.613944    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nsbc4"
Sep 17 15:46:25.992581 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:25.992554    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:26.095127 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:26.095086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:35.864232 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:35.864192    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:36.007702 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:36.007665    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:46:36.108515 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:46:36.108474    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:09.306755 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.306724    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-6lzj2"]
Sep 17 15:47:09.309896 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.309879    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.316509 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.316157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Sep 17 15:47:09.319162 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.319145    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-bdgj2\""
Sep 17 15:47:09.333722 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.333701    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-6lzj2"]
Sep 17 15:47:09.473877 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.473843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghb66\" (UniqueName: \"kubernetes.io/projected/f4206784-e1f4-4c66-a5e2-3209c94a52e0-kube-api-access-ghb66\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.473877 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.473882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4206784-e1f4-4c66-a5e2-3209c94a52e0-tls-certs\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.574638 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.574554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghb66\" (UniqueName: \"kubernetes.io/projected/f4206784-e1f4-4c66-a5e2-3209c94a52e0-kube-api-access-ghb66\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.574638 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.574593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4206784-e1f4-4c66-a5e2-3209c94a52e0-tls-certs\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.577121 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.577104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4206784-e1f4-4c66-a5e2-3209c94a52e0-tls-certs\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.585898 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.585866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghb66\" (UniqueName: \"kubernetes.io/projected/f4206784-e1f4-4c66-a5e2-3209c94a52e0-kube-api-access-ghb66\") pod \"model-serving-api-7b954ffc95-6lzj2\" (UID: \"f4206784-e1f4-4c66-a5e2-3209c94a52e0\") " pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.619840 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.619814    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:09.769785 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.769753    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:09.875026 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.874955    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:09.900701 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:09.900679    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-6lzj2"]
Sep 17 15:47:09.903345 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:47:09.903321    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4206784_e1f4_4c66_a5e2_3209c94a52e0.slice/crio-d7f931fbd2c20c76e3b9555676a34b8d7f8b47673924278ed3c6c0f9ee864f6b WatchSource:0}: Error finding container d7f931fbd2c20c76e3b9555676a34b8d7f8b47673924278ed3c6c0f9ee864f6b: Status 404 returned error can't find the container with id d7f931fbd2c20c76e3b9555676a34b8d7f8b47673924278ed3c6c0f9ee864f6b
Sep 17 15:47:10.885739 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:10.885698    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-6lzj2" event={"ID":"f4206784-e1f4-4c66-a5e2-3209c94a52e0","Type":"ContainerStarted","Data":"d7f931fbd2c20c76e3b9555676a34b8d7f8b47673924278ed3c6c0f9ee864f6b"}
Sep 17 15:47:11.364402 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:11.364351    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:11.427719 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:11.427690    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:12.894401 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:12.894360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-6lzj2" event={"ID":"f4206784-e1f4-4c66-a5e2-3209c94a52e0","Type":"ContainerStarted","Data":"e4c0fcca34d93a73bc5129ba4b21890533664c6ce076a8390ccb14c17a88248c"}
Sep 17 15:47:12.894880 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:12.894424    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:12.925507 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:12.925447    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-6lzj2" podStartSLOduration=1.580871005 podStartE2EDuration="3.925430828s" totalImagesPullingTime="2.344559823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:47:12.922805633 +0000 UTC m=+499.602412387" watchObservedRunningTime="2026-09-17 15:47:12.925430828 +0000 UTC m=+499.605037583"
Sep 17 15:47:23.902046 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:23.902017    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-6lzj2"
Sep 17 15:47:31.076628 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:31.076586    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:47:34.703396 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:47:34.703358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:45.121147 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:45.121108    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:45.202321 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:45.202288    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:53.762698 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:53.762673    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:48:53.764560 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:53.764540    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:48:54.641224 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:54.641189    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.069463 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.069419    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.324103 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.324016    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.460386 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.460351    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.643822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.643742    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.662714 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.662683    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:48:57.665846 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.665831    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.668633 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.668609    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-13ed5-kube-rbac-proxy-sar-config\""
Sep 17 15:48:57.668756 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.668686    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-13ed5-predictor-serving-cert\""
Sep 17 15:48:57.668832 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.668818    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9nh5v\""
Sep 17 15:48:57.668920 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.668904    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 15:48:57.669111 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.669097    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 15:48:57.682135 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.682109    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:48:57.747910 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.747872    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.854665 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.854635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.854838 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.854678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxv79\" (UniqueName: \"kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.854838 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.854704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.955596 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.955492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.955596 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.955547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxv79\" (UniqueName: \"kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.955596 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.955586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.956226 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.956203    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.958168 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.958142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.971204 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.971175    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxv79\" (UniqueName: \"kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79\") pod \"error-404-isvc-13ed5-predictor-85c7867f57-hlg9z\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") " pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:57.973602 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.973569    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:57.976425 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:57.976407    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:48:58.074097 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:58.074061    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:58.183959 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:58.183922    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:58.275147 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:58.275114    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:48:58.279633 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:48:58.279606    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c645cc_ce96_4341_8ff8_fc0287fa18aa.slice/crio-73da3b677c2e8d2ac59495f324a5f421d4d3d1a187e639d5b148bbb42ca12190 WatchSource:0}: Error finding container 73da3b677c2e8d2ac59495f324a5f421d4d3d1a187e639d5b148bbb42ca12190: Status 404 returned error can't find the container with id 73da3b677c2e8d2ac59495f324a5f421d4d3d1a187e639d5b148bbb42ca12190
Sep 17 15:48:58.335824 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:58.335793    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:48:59.291421 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:48:59.291380    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerStarted","Data":"73da3b677c2e8d2ac59495f324a5f421d4d3d1a187e639d5b148bbb42ca12190"}
Sep 17 15:49:10.227139 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:10.227114    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:49:10.340462 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:10.340425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerStarted","Data":"78b7c8f306d15b333ea055679cf81dca799061204561adf0c2175b465e9ce737"}
Sep 17 15:49:15.363355 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:15.363299    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerStarted","Data":"0ea8a46cea5fc5de126a6200f2c50cebe13ef557c0e53e16b922c0c33c5ca11a"}
Sep 17 15:49:15.363787 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:15.363417    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:49:15.363787 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:15.363459    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:49:15.364875 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:15.364842    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:49:15.390636 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:15.390586    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podStartSLOduration=2.133715341 podStartE2EDuration="18.390570647s" totalImagesPullingTime="16.256855306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:48:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:49:15.388986608 +0000 UTC m=+622.068593364" watchObservedRunningTime="2026-09-17 15:49:15.390570647 +0000 UTC m=+622.070177401"
Sep 17 15:49:16.367345 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:16.367310    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:49:21.372144 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:21.372114    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:49:21.372595 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:21.372570    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:49:28.290348 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:28.290316    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:49:28.361029 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:28.360992    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:49:31.373244 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:31.373207    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:49:41.372880 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:41.372837    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:49:51.372680 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:49:51.372639    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 17 15:50:01.373313 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:01.373246    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:50:17.192287 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:17.192250    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:50:17.471240 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:17.471203    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:50:31.328434 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.328404    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:50:31.630580 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.630503    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:50:31.630756 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.630720    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container" containerID="cri-o://78b7c8f306d15b333ea055679cf81dca799061204561adf0c2175b465e9ce737" gracePeriod=30
Sep 17 15:50:31.630821 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.630772    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kube-rbac-proxy" containerID="cri-o://0ea8a46cea5fc5de126a6200f2c50cebe13ef557c0e53e16b922c0c33c5ca11a" gracePeriod=30
Sep 17 15:50:31.835542 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.835512    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:50:31.838108 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.838091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:31.840479 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.840455    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-795b5-predictor-serving-cert\""
Sep 17 15:50:31.840569 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.840556    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-795b5-kube-rbac-proxy-sar-config\""
Sep 17 15:50:31.850360 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.850338    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:50:31.936495 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.936430    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:31.936495 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.936477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxvc7\" (UniqueName: \"kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:31.936641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:31.936497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.037665 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.037636    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxvc7\" (UniqueName: \"kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.037665 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.037668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.037908 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.037720    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.037908 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:50:32.037806    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-795b5-predictor-serving-cert: secret "error-404-isvc-795b5-predictor-serving-cert" not found
Sep 17 15:50:32.037908 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:50:32.037871    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls podName:f047b69c-2da6-4c69-9eb6-c0996fd2f3bb nodeName:}" failed. No retries permitted until 2026-09-17 15:50:32.537852864 +0000 UTC m=+699.217459610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls") pod "error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" (UID: "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb") : secret "error-404-isvc-795b5-predictor-serving-cert" not found
Sep 17 15:50:32.038412 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.038385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.053220 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.053196    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxvc7\" (UniqueName: \"kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.541571 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.541532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:32.542126 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:50:32.541677    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-795b5-predictor-serving-cert: secret "error-404-isvc-795b5-predictor-serving-cert" not found
Sep 17 15:50:32.542126 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:50:32.541741    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls podName:f047b69c-2da6-4c69-9eb6-c0996fd2f3bb nodeName:}" failed. No retries permitted until 2026-09-17 15:50:33.541725829 +0000 UTC m=+700.221332567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls") pod "error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" (UID: "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb") : secret "error-404-isvc-795b5-predictor-serving-cert" not found
Sep 17 15:50:32.547992 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.547962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:50:32.650201 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.650167    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerID="0ea8a46cea5fc5de126a6200f2c50cebe13ef557c0e53e16b922c0c33c5ca11a" exitCode=2
Sep 17 15:50:32.650402 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.650241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerDied","Data":"0ea8a46cea5fc5de126a6200f2c50cebe13ef557c0e53e16b922c0c33c5ca11a"}
Sep 17 15:50:32.793338 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:32.793249    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:50:33.550822 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:33.550785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:33.553391 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:33.553369    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") " pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:33.648266 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:33.648178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:33.922864 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:33.922774    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:50:33.926721 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:50:33.926689    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf047b69c_2da6_4c69_9eb6_c0996fd2f3bb.slice/crio-d6fc07f1196d4b6a3490bfc3ea045c32b2687ea7baac6d1eec83bbc49340704a WatchSource:0}: Error finding container d6fc07f1196d4b6a3490bfc3ea045c32b2687ea7baac6d1eec83bbc49340704a: Status 404 returned error can't find the container with id d6fc07f1196d4b6a3490bfc3ea045c32b2687ea7baac6d1eec83bbc49340704a
Sep 17 15:50:34.662194 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.662155    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerID="78b7c8f306d15b333ea055679cf81dca799061204561adf0c2175b465e9ce737" exitCode=0
Sep 17 15:50:34.662647 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.662192    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerDied","Data":"78b7c8f306d15b333ea055679cf81dca799061204561adf0c2175b465e9ce737"}
Sep 17 15:50:34.664325 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.664299    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerStarted","Data":"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"}
Sep 17 15:50:34.664456 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.664364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerStarted","Data":"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"}
Sep 17 15:50:34.664456 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.664397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerStarted","Data":"d6fc07f1196d4b6a3490bfc3ea045c32b2687ea7baac6d1eec83bbc49340704a"}
Sep 17 15:50:34.664571 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.664486    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:34.695495 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.695439    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podStartSLOduration=3.695419639 podStartE2EDuration="3.695419639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:50:34.693863001 +0000 UTC m=+701.373469757" watchObservedRunningTime="2026-09-17 15:50:34.695419639 +0000 UTC m=+701.375026395"
Sep 17 15:50:34.773057 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.773033    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:50:34.858402 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.858307    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls\") pod \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") "
Sep 17 15:50:34.858402 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.858350    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxv79\" (UniqueName: \"kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79\") pod \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") "
Sep 17 15:50:34.858609 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.858423    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config\") pod \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\" (UID: \"d0c645cc-ce96-4341-8ff8-fc0287fa18aa\") "
Sep 17 15:50:34.858842 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.858810    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d0c645cc-ce96-4341-8ff8-fc0287fa18aa" (UID: "d0c645cc-ce96-4341-8ff8-fc0287fa18aa"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:50:34.860805 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.860782    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d0c645cc-ce96-4341-8ff8-fc0287fa18aa" (UID: "d0c645cc-ce96-4341-8ff8-fc0287fa18aa"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:50:34.860890 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.860836    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79" (OuterVolumeSpecName: "kube-api-access-fxv79") pod "d0c645cc-ce96-4341-8ff8-fc0287fa18aa" (UID: "d0c645cc-ce96-4341-8ff8-fc0287fa18aa"). InnerVolumeSpecName "kube-api-access-fxv79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:50:34.959647 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.959610    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:50:34.959647 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.959640    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:50:34.959647 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:34.959650    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxv79\" (UniqueName: \"kubernetes.io/projected/d0c645cc-ce96-4341-8ff8-fc0287fa18aa-kube-api-access-fxv79\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:50:35.670039 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.669999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z" event={"ID":"d0c645cc-ce96-4341-8ff8-fc0287fa18aa","Type":"ContainerDied","Data":"73da3b677c2e8d2ac59495f324a5f421d4d3d1a187e639d5b148bbb42ca12190"}
Sep 17 15:50:35.670039 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.670029    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"
Sep 17 15:50:35.670561 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.670073    2568 scope.go:117] "RemoveContainer" containerID="0ea8a46cea5fc5de126a6200f2c50cebe13ef557c0e53e16b922c0c33c5ca11a"
Sep 17 15:50:35.670561 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.670458    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:35.671979 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.671956    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:50:35.678528 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.678513    2568 scope.go:117] "RemoveContainer" containerID="78b7c8f306d15b333ea055679cf81dca799061204561adf0c2175b465e9ce737"
Sep 17 15:50:35.694584 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.694560    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:50:35.701779 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.701757    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13ed5-predictor-85c7867f57-hlg9z"]
Sep 17 15:50:35.834934 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:35.834901    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" path="/var/lib/kubelet/pods/d0c645cc-ce96-4341-8ff8-fc0287fa18aa/volumes"
Sep 17 15:50:36.675145 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:36.675106    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:50:41.680306 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:41.680260    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:50:41.680797 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:41.680757    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:50:51.681430 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:50:51.681346    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:51:01.297088 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:01.297052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:01.681182 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:01.681100    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:51:11.681153 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:11.681114    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 17 15:51:17.189404 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:17.189358    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:17.589578 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:17.589545    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:21.681990 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:21.681962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:51:27.690431 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:27.690393    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:27.835313 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:27.835264    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:27.918610 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:27.918580    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:27.988333 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:27.988294    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:28.117076 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.117042    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:28.135327 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135298    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 15:51:28.135594 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135583    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kube-rbac-proxy"
Sep 17 15:51:28.135641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135596    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kube-rbac-proxy"
Sep 17 15:51:28.135641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135621    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container"
Sep 17 15:51:28.135641 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135626    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container"
Sep 17 15:51:28.135734 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135668    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kube-rbac-proxy"
Sep 17 15:51:28.135734 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.135676    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c645cc-ce96-4341-8ff8-fc0287fa18aa" containerName="kserve-container"
Sep 17 15:51:28.137221 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.137208    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.139629 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.139607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-9ed13-predictor-serving-cert\""
Sep 17 15:51:28.139747 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.139611    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-9ed13-kube-rbac-proxy-sar-config\""
Sep 17 15:51:28.152255 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.152229    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 15:51:28.251125 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.251035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.251125 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.251082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.251401 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.251157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2js7b\" (UniqueName: \"kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.268600 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.268567    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:28.351548 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.351508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2js7b\" (UniqueName: \"kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.351747 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.351584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.351747 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.351624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.352353 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.352330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.354193 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.354168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.367001 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.366976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2js7b\" (UniqueName: \"kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b\") pod \"error-404-isvc-9ed13-predictor-87448bd4f-m6g4z\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") " pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.391386 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.391360    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:28.453121 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.453091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.729929 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.729896    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 15:51:28.732878 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:51:28.732851    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd45a2c1_0b32_4948_b09e_109d7d484953.slice/crio-30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a WatchSource:0}: Error finding container 30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a: Status 404 returned error can't find the container with id 30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a
Sep 17 15:51:28.871220 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.871188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerStarted","Data":"2adb0713b82f23c50755f38986dee1624911461dd88f96280c330da2b3445f90"}
Sep 17 15:51:28.871352 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.871250    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerStarted","Data":"2de4026cc15e62c7ed2ab5720c40e83eb1ec8a5ec6f1c45784c2bd47577bbeec"}
Sep 17 15:51:28.871352 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.871292    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerStarted","Data":"30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a"}
Sep 17 15:51:28.871463 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.871449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.871502 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.871482    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:28.873102 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.873059    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:51:28.918750 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:28.918703    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podStartSLOduration=0.91868675 podStartE2EDuration="918.68675ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:51:28.91840022 +0000 UTC m=+755.598006976" watchObservedRunningTime="2026-09-17 15:51:28.91868675 +0000 UTC m=+755.598293505"
Sep 17 15:51:29.875239 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:29.875200    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:51:31.602729 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:31.602697    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:32.282734 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:32.282698    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:51:34.879579 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:34.879547    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:51:34.880146 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:34.880118    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:51:44.880775 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:44.880737    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:51:54.880549 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:51:54.880500    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:52:04.880355 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:52:04.880309    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 15:52:14.880538 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:52:14.880459    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 15:52:27.922706 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:52:27.922653    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:52:28.395552 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:52:28.395518    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:53:13.574578 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:53:13.574540    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:53:13.642453 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:53:13.642269    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:53:53.792322 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:53:53.792225    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:53:53.792868 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:53:53.792513    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:55:19.910210 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:55:19.910131    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:58:53.816984 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:58:53.816953    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:58:53.817986 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:58:53.817965    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 15:59:46.377225 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.377146    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:59:46.622644 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.622615    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:59:46.622869 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.622844    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container" containerID="cri-o://7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b" gracePeriod=30
Sep 17 15:59:46.622961 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.622931    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kube-rbac-proxy" containerID="cri-o://9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b" gracePeriod=30
Sep 17 15:59:46.675582 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.675541    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 17 15:59:46.719286 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.719250    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 15:59:46.722561 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.722541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.724925 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.724899    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8d4df-kube-rbac-proxy-sar-config\""
Sep 17 15:59:46.724925 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.724914    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8d4df-predictor-serving-cert\""
Sep 17 15:59:46.736018 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.735990    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 15:59:46.872628 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.872592    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.872628 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.872626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6nqr\" (UniqueName: \"kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.872841 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.872656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.908946 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.908867    2568 generic.go:356] "Generic (PLEG): container finished" podID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerID="9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b" exitCode=2
Sep 17 15:59:46.908946 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.908933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerDied","Data":"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"}
Sep 17 15:59:46.973350 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.973317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.973534 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.973425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.973695 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.973657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6nqr\" (UniqueName: \"kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.974127 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.974108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.975891 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.975868    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:46.983754 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:46.983724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6nqr\" (UniqueName: \"kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr\") pod \"error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") " pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:47.032768 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.032735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:47.314638 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.314615    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 15:59:47.316668 ip-10-0-128-116 kubenswrapper[2568]: W0917 15:59:47.316642    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb799025b_feff_4ecb_890a_80fcd214ec4f.slice/crio-e4d66472e3df71fbccdb5efef8efe66f3aa0b541f2e83bcccede0cf0fcca240f WatchSource:0}: Error finding container e4d66472e3df71fbccdb5efef8efe66f3aa0b541f2e83bcccede0cf0fcca240f: Status 404 returned error can't find the container with id e4d66472e3df71fbccdb5efef8efe66f3aa0b541f2e83bcccede0cf0fcca240f
Sep 17 15:59:47.688376 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.688251    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 15:59:47.914666 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.914636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerStarted","Data":"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"}
Sep 17 15:59:47.914857 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.914700    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:47.914857 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.914721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerStarted","Data":"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"}
Sep 17 15:59:47.914857 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.914749    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerStarted","Data":"e4d66472e3df71fbccdb5efef8efe66f3aa0b541f2e83bcccede0cf0fcca240f"}
Sep 17 15:59:47.914997 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.914863    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:47.916216 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.916196    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 15:59:47.943306 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:47.943187    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podStartSLOduration=1.943172572 podStartE2EDuration="1.943172572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:59:47.941590646 +0000 UTC m=+1254.621197401" watchObservedRunningTime="2026-09-17 15:59:47.943172572 +0000 UTC m=+1254.622779327"
Sep 17 15:59:48.919198 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:48.919158    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 15:59:49.767593 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.767568    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:59:49.895133 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.895042    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") pod \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") "
Sep 17 15:59:49.895133 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.895104    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config\") pod \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") "
Sep 17 15:59:49.895384 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.895153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxvc7\" (UniqueName: \"kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7\") pod \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\" (UID: \"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb\") "
Sep 17 15:59:49.895500 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.895477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" (UID: "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:59:49.897394 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.897371    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" (UID: "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:59:49.897547 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.897531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7" (OuterVolumeSpecName: "kube-api-access-wxvc7") pod "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" (UID: "f047b69c-2da6-4c69-9eb6-c0996fd2f3bb"). InnerVolumeSpecName "kube-api-access-wxvc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:59:49.924702 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.924674    2568 generic.go:356] "Generic (PLEG): container finished" podID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerID="7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b" exitCode=0
Sep 17 15:59:49.925029 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.924716    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"
Sep 17 15:59:49.925029 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.924752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerDied","Data":"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"}
Sep 17 15:59:49.925029 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.924817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn" event={"ID":"f047b69c-2da6-4c69-9eb6-c0996fd2f3bb","Type":"ContainerDied","Data":"d6fc07f1196d4b6a3490bfc3ea045c32b2687ea7baac6d1eec83bbc49340704a"}
Sep 17 15:59:49.925029 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.924856    2568 scope.go:117] "RemoveContainer" containerID="9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"
Sep 17 15:59:49.933141 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.933120    2568 scope.go:117] "RemoveContainer" containerID="7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"
Sep 17 15:59:49.940161 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.940143    2568 scope.go:117] "RemoveContainer" containerID="9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"
Sep 17 15:59:49.940440 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:59:49.940415    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b\": container with ID starting with 9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b not found: ID does not exist" containerID="9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"
Sep 17 15:59:49.940541 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.940515    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b"} err="failed to get container status \"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b\": rpc error: code = NotFound desc = could not find container \"9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b\": container with ID starting with 9212111fe7de8d934ecd34232f2c94ccba0513e932116cb8039cae952ff2305b not found: ID does not exist"
Sep 17 15:59:49.940608 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.940546    2568 scope.go:117] "RemoveContainer" containerID="7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"
Sep 17 15:59:49.940825 ip-10-0-128-116 kubenswrapper[2568]: E0917 15:59:49.940806    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b\": container with ID starting with 7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b not found: ID does not exist" containerID="7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"
Sep 17 15:59:49.940895 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.940829    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b"} err="failed to get container status \"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b\": rpc error: code = NotFound desc = could not find container \"7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b\": container with ID starting with 7e1bc029cee4ca690521cbeedbc28dd15ad371abb9f5df51357785d7ba52fd1b not found: ID does not exist"
Sep 17 15:59:49.947829 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.947809    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:59:49.953390 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.953371    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-795b5-predictor-85d4bfc6d5-jltpn"]
Sep 17 15:59:49.996114 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.996091    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:59:49.996114 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.996110    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxvc7\" (UniqueName: \"kubernetes.io/projected/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-kube-api-access-wxvc7\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:59:49.996245 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:49.996121    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 15:59:51.834568 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:51.834537    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" path="/var/lib/kubelet/pods/f047b69c-2da6-4c69-9eb6-c0996fd2f3bb/volumes"
Sep 17 15:59:53.923862 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:53.923836    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 15:59:53.924305 ip-10-0-128-116 kubenswrapper[2568]: I0917 15:59:53.924259    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 16:00:03.924837 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:03.924796    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 16:00:13.925066 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:13.925028    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 16:00:23.925221 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:23.925182    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 17 16:00:31.790997 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:31.790962    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:33.925438 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:33.925404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 16:00:42.679846 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.679802    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:42.887970 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.887936    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:42.924262 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.924231    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 16:00:42.924500 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.924479    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" containerID="cri-o://2de4026cc15e62c7ed2ab5720c40e83eb1ec8a5ec6f1c45784c2bd47577bbeec" gracePeriod=30
Sep 17 16:00:42.924624 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.924580    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kube-rbac-proxy" containerID="cri-o://2adb0713b82f23c50755f38986dee1624911461dd88f96280c330da2b3445f90" gracePeriod=30
Sep 17 16:00:42.955565 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:42.955539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:43.026706 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.026673    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:43.120409 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.120374    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:43.139986 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.139951    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:00:43.140255 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140243    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kube-rbac-proxy"
Sep 17 16:00:43.140340 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140257    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kube-rbac-proxy"
Sep 17 16:00:43.140340 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140267    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container"
Sep 17 16:00:43.140340 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140290    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container"
Sep 17 16:00:43.140494 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140365    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kserve-container"
Sep 17 16:00:43.140494 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.140375    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f047b69c-2da6-4c69-9eb6-c0996fd2f3bb" containerName="kube-rbac-proxy"
Sep 17 16:00:43.143208 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.143188    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.146716 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.146611    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-efa50-predictor-serving-cert\""
Sep 17 16:00:43.146716 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.146615    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-efa50-kube-rbac-proxy-sar-config\""
Sep 17 16:00:43.147635 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.147613    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerID="2adb0713b82f23c50755f38986dee1624911461dd88f96280c330da2b3445f90" exitCode=2
Sep 17 16:00:43.147729 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.147671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerDied","Data":"2adb0713b82f23c50755f38986dee1624911461dd88f96280c330da2b3445f90"}
Sep 17 16:00:43.158824 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.158804    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:00:43.199002 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.198915    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:43.200968 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.200948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsql7\" (UniqueName: \"kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.201032 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.200996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.201083 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.201045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.302422 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.302384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.302604 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.302431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.302604 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.302486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsql7\" (UniqueName: \"kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.302604 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:00:43.302540    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-efa50-predictor-serving-cert: secret "error-404-isvc-efa50-predictor-serving-cert" not found
Sep 17 16:00:43.302771 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:00:43.302615    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls podName:bc4f392b-f2e2-4736-acca-e24b9dc3ad48 nodeName:}" failed. No retries permitted until 2026-09-17 16:00:43.802593003 +0000 UTC m=+1310.482199750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls") pod "error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" (UID: "bc4f392b-f2e2-4736-acca-e24b9dc3ad48") : secret "error-404-isvc-efa50-predictor-serving-cert" not found
Sep 17 16:00:43.303083 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.303063    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.313933 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.313901    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsql7\" (UniqueName: \"kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.812740 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.812695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:43.813147 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:00:43.812862    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-efa50-predictor-serving-cert: secret "error-404-isvc-efa50-predictor-serving-cert" not found
Sep 17 16:00:43.813147 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:00:43.812932    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls podName:bc4f392b-f2e2-4736-acca-e24b9dc3ad48 nodeName:}" failed. No retries permitted until 2026-09-17 16:00:44.81291759 +0000 UTC m=+1311.492524323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls") pod "error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" (UID: "bc4f392b-f2e2-4736-acca-e24b9dc3ad48") : secret "error-404-isvc-efa50-predictor-serving-cert" not found
Sep 17 16:00:43.922234 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:43.922203    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:44.821522 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:44.821470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:44.824060 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:44.824040    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"error-404-isvc-efa50-predictor-66b96c7d87-5s7k6\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") " pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:44.875590 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:44.875555    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.23:8643/healthz\": dial tcp 10.132.0.23:8643: connect: connection refused"
Sep 17 16:00:44.880942 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:44.880917    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 17 16:00:44.954624 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:44.954597    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:45.241583 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:45.241554    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:00:45.243810 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:00:45.243780    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4f392b_f2e2_4736_acca_e24b9dc3ad48.slice/crio-39c5315229e8ed728786af0e211a4366c6328ebe622eb44d424ec07c568754a1 WatchSource:0}: Error finding container 39c5315229e8ed728786af0e211a4366c6328ebe622eb44d424ec07c568754a1: Status 404 returned error can't find the container with id 39c5315229e8ed728786af0e211a4366c6328ebe622eb44d424ec07c568754a1
Sep 17 16:00:46.162403 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.162373    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerID="2de4026cc15e62c7ed2ab5720c40e83eb1ec8a5ec6f1c45784c2bd47577bbeec" exitCode=0
Sep 17 16:00:46.162758 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.162450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerDied","Data":"2de4026cc15e62c7ed2ab5720c40e83eb1ec8a5ec6f1c45784c2bd47577bbeec"}
Sep 17 16:00:46.162758 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.162511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z" event={"ID":"fd45a2c1-0b32-4948-b09e-109d7d484953","Type":"ContainerDied","Data":"30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a"}
Sep 17 16:00:46.162758 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.162538    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30f4c040ea215bfe47b37512c84b31f56cd19328599571e862d4b8bd6900ec9a"
Sep 17 16:00:46.164686 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.164660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerStarted","Data":"a318d06aca2122457969f5d8271dd12b51460aeb22132c118e5fd8c502a7c06f"}
Sep 17 16:00:46.164814 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.164709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerStarted","Data":"9c6d91d8cc25cd5a18e9bef56d99dd475263d9a630ee23ed04e77d2e1a240208"}
Sep 17 16:00:46.164814 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.164728    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerStarted","Data":"39c5315229e8ed728786af0e211a4366c6328ebe622eb44d424ec07c568754a1"}
Sep 17 16:00:46.164926 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.164837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:46.170819 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.170800    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 16:00:46.188861 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.188818    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podStartSLOduration=3.188805219 podStartE2EDuration="3.188805219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:00:46.188012917 +0000 UTC m=+1312.867619671" watchObservedRunningTime="2026-09-17 16:00:46.188805219 +0000 UTC m=+1312.868412050"
Sep 17 16:00:46.234181 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.234150    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls\") pod \"fd45a2c1-0b32-4948-b09e-109d7d484953\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") "
Sep 17 16:00:46.234430 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.234239    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2js7b\" (UniqueName: \"kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b\") pod \"fd45a2c1-0b32-4948-b09e-109d7d484953\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") "
Sep 17 16:00:46.234430 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.234319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config\") pod \"fd45a2c1-0b32-4948-b09e-109d7d484953\" (UID: \"fd45a2c1-0b32-4948-b09e-109d7d484953\") "
Sep 17 16:00:46.234738 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.234706    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fd45a2c1-0b32-4948-b09e-109d7d484953" (UID: "fd45a2c1-0b32-4948-b09e-109d7d484953"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:00:46.236458 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.236438    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fd45a2c1-0b32-4948-b09e-109d7d484953" (UID: "fd45a2c1-0b32-4948-b09e-109d7d484953"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:00:46.236555 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.236489    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b" (OuterVolumeSpecName: "kube-api-access-2js7b") pod "fd45a2c1-0b32-4948-b09e-109d7d484953" (UID: "fd45a2c1-0b32-4948-b09e-109d7d484953"). InnerVolumeSpecName "kube-api-access-2js7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:00:46.335613 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.335579    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:00:46.335613 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.335606    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fd45a2c1-0b32-4948-b09e-109d7d484953-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:00:46.335613 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.335618    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2js7b\" (UniqueName: \"kubernetes.io/projected/fd45a2c1-0b32-4948-b09e-109d7d484953-kube-api-access-2js7b\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:00:46.556844 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:46.556756    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:47.169336 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.169309    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"
Sep 17 16:00:47.169809 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.169426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:47.170921 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.170892    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:00:47.202255 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.202225    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 16:00:47.205306 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.205246    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ed13-predictor-87448bd4f-m6g4z"]
Sep 17 16:00:47.835461 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:47.835431    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" path="/var/lib/kubelet/pods/fd45a2c1-0b32-4948-b09e-109d7d484953/volumes"
Sep 17 16:00:48.173179 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:48.173100    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:00:49.134533 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:49.134499    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:53.178170 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:53.178140    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:00:53.178595 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:53.178566    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:00:53.867441 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:53.867413    2568 scope.go:117] "RemoveContainer" containerID="2de4026cc15e62c7ed2ab5720c40e83eb1ec8a5ec6f1c45784c2bd47577bbeec"
Sep 17 16:00:53.875455 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:53.875425    2568 scope.go:117] "RemoveContainer" containerID="2adb0713b82f23c50755f38986dee1624911461dd88f96280c330da2b3445f90"
Sep 17 16:00:56.639661 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.639568    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:56.741687 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.741656    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:56.754030 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.754003    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 16:00:56.754242 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.754218    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container" containerID="cri-o://c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598" gracePeriod=30
Sep 17 16:00:56.754340 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.754250    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kube-rbac-proxy" containerID="cri-o://2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325" gracePeriod=30
Sep 17 16:00:56.941289 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941199    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:00:56.941695 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941680    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container"
Sep 17 16:00:56.941739 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941699    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container"
Sep 17 16:00:56.941739 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941728    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kube-rbac-proxy"
Sep 17 16:00:56.941739 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941736    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kube-rbac-proxy"
Sep 17 16:00:56.941840 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941815    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kube-rbac-proxy"
Sep 17 16:00:56.941840 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.941829    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd45a2c1-0b32-4948-b09e-109d7d484953" containerName="kserve-container"
Sep 17 16:00:56.945110 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.945092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:56.947417 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.947390    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bfbea-kube-rbac-proxy-sar-config\""
Sep 17 16:00:56.947417 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.947416    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bfbea-predictor-serving-cert\""
Sep 17 16:00:56.955856 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:56.955835    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:00:57.017863 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.017822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.017863 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.017865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.018085 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.017888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt82r\" (UniqueName: \"kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.118824 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.118784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.118998 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.118830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.118998 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.118859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt82r\" (UniqueName: \"kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.119549 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.119530    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.121548 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.121529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.129893 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.129872    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt82r\" (UniqueName: \"kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r\") pod \"error-404-isvc-bfbea-predictor-858c7548df-d6twf\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") " pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.211556 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.211477    2568 generic.go:356] "Generic (PLEG): container finished" podID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerID="2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325" exitCode=2
Sep 17 16:00:57.211685 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.211550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerDied","Data":"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"}
Sep 17 16:00:57.255398 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.255372    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:57.533411 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:57.533388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:00:57.535932 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:00:57.535907    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607017b1_f5c6_4e2b_ac46_dcb22939cc56.slice/crio-13ab5cd143a69cfe6b7226768027820708278b21363a24a5881bb9050ae68511 WatchSource:0}: Error finding container 13ab5cd143a69cfe6b7226768027820708278b21363a24a5881bb9050ae68511: Status 404 returned error can't find the container with id 13ab5cd143a69cfe6b7226768027820708278b21363a24a5881bb9050ae68511
Sep 17 16:00:58.218317 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.218262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerStarted","Data":"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"}
Sep 17 16:00:58.218822 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.218345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerStarted","Data":"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"}
Sep 17 16:00:58.218822 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.218373    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerStarted","Data":"13ab5cd143a69cfe6b7226768027820708278b21363a24a5881bb9050ae68511"}
Sep 17 16:00:58.218822 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.218407    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:58.238404 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.238236    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podStartSLOduration=2.238217896 podStartE2EDuration="2.238217896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:00:58.237930552 +0000 UTC m=+1324.917537308" watchObservedRunningTime="2026-09-17 16:00:58.238217896 +0000 UTC m=+1324.917824653"
Sep 17 16:00:58.842823 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.842775    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:58.919711 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.919668    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 17 16:00:58.944188 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:58.944159    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:00:59.223779 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:59.223746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:00:59.225173 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:59.225146    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:00:59.998459 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:00:59.998431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 16:01:00.143478 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.143392    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls\") pod \"b799025b-feff-4ecb-890a-80fcd214ec4f\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") "
Sep 17 16:01:00.143478 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.143429    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6nqr\" (UniqueName: \"kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr\") pod \"b799025b-feff-4ecb-890a-80fcd214ec4f\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") "
Sep 17 16:01:00.143705 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.143492    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config\") pod \"b799025b-feff-4ecb-890a-80fcd214ec4f\" (UID: \"b799025b-feff-4ecb-890a-80fcd214ec4f\") "
Sep 17 16:01:00.143891 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.143863    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b799025b-feff-4ecb-890a-80fcd214ec4f" (UID: "b799025b-feff-4ecb-890a-80fcd214ec4f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:01:00.145758 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.145722    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr" (OuterVolumeSpecName: "kube-api-access-m6nqr") pod "b799025b-feff-4ecb-890a-80fcd214ec4f" (UID: "b799025b-feff-4ecb-890a-80fcd214ec4f"). InnerVolumeSpecName "kube-api-access-m6nqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:01:00.145858 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.145790    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b799025b-feff-4ecb-890a-80fcd214ec4f" (UID: "b799025b-feff-4ecb-890a-80fcd214ec4f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:01:00.229561 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.229521    2568 generic.go:356] "Generic (PLEG): container finished" podID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerID="c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598" exitCode=0
Sep 17 16:01:00.229959 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.229577    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"
Sep 17 16:01:00.229959 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.229608    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerDied","Data":"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"}
Sep 17 16:01:00.229959 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.229673    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb" event={"ID":"b799025b-feff-4ecb-890a-80fcd214ec4f","Type":"ContainerDied","Data":"e4d66472e3df71fbccdb5efef8efe66f3aa0b541f2e83bcccede0cf0fcca240f"}
Sep 17 16:01:00.229959 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.229700    2568 scope.go:117] "RemoveContainer" containerID="2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"
Sep 17 16:01:00.230342 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.230310    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:00.238939 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.238923    2568 scope.go:117] "RemoveContainer" containerID="c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"
Sep 17 16:01:00.244241 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.244223    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:00.244337 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.244244    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b799025b-feff-4ecb-890a-80fcd214ec4f-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:00.244337 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.244253    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6nqr\" (UniqueName: \"kubernetes.io/projected/b799025b-feff-4ecb-890a-80fcd214ec4f-kube-api-access-m6nqr\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:00.246398 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.246383    2568 scope.go:117] "RemoveContainer" containerID="2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"
Sep 17 16:01:00.246622 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:01:00.246605    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325\": container with ID starting with 2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325 not found: ID does not exist" containerID="2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"
Sep 17 16:01:00.246675 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.246630    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325"} err="failed to get container status \"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325\": rpc error: code = NotFound desc = could not find container \"2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325\": container with ID starting with 2e9baa88849f103f6238bd52b31a1f3686073d934edeb34eb93e085b5836c325 not found: ID does not exist"
Sep 17 16:01:00.246675 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.246648    2568 scope.go:117] "RemoveContainer" containerID="c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"
Sep 17 16:01:00.246886 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:01:00.246870    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598\": container with ID starting with c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598 not found: ID does not exist" containerID="c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"
Sep 17 16:01:00.246929 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.246889    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598"} err="failed to get container status \"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598\": rpc error: code = NotFound desc = could not find container \"c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598\": container with ID starting with c2b1d30f759a2d8399adce4b47b375b00d4ea33470b46913c93ea4b7d182a598 not found: ID does not exist"
Sep 17 16:01:00.252984 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.252963    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 16:01:00.258765 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:00.258745    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8d4df-predictor-567ff97bd5-5qvpb"]
Sep 17 16:01:01.834900 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:01.834858    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" path="/var/lib/kubelet/pods/b799025b-feff-4ecb-890a-80fcd214ec4f/volumes"
Sep 17 16:01:03.178802 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:03.178761    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:01:05.234438 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:05.234409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:01:05.234849 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:05.234825    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:13.179359 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:13.179309    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:01:15.235309 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:15.235193    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:23.179197 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:23.179150    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 16:01:25.234948 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:25.234909    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:33.179417 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:33.179389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:01:35.235513 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:35.235473    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:42.903391 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:42.903349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:43.013020 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:43.012981    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:45.235651 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:45.235615    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 16:01:53.044222 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.044175    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:53.137598 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.137567    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:01:53.137888 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.137859    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container" containerID="cri-o://9c6d91d8cc25cd5a18e9bef56d99dd475263d9a630ee23ed04e77d2e1a240208" gracePeriod=30
Sep 17 16:01:53.138039 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.137881    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kube-rbac-proxy" containerID="cri-o://a318d06aca2122457969f5d8271dd12b51460aeb22132c118e5fd8c502a7c06f" gracePeriod=30
Sep 17 16:01:53.138820 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.138344    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:53.174335 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.174296    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused"
Sep 17 16:01:53.331175 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331096    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:01:53.331556 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331541    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container"
Sep 17 16:01:53.331605 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331559    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container"
Sep 17 16:01:53.331605 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331596    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kube-rbac-proxy"
Sep 17 16:01:53.331685 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331604    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kube-rbac-proxy"
Sep 17 16:01:53.331685 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331669    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kube-rbac-proxy"
Sep 17 16:01:53.331685 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.331683    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b799025b-feff-4ecb-890a-80fcd214ec4f" containerName="kserve-container"
Sep 17 16:01:53.334980 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.334963    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.337237 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.337208    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-923c8-predictor-serving-cert\""
Sep 17 16:01:53.337400 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.337243    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-923c8-kube-rbac-proxy-sar-config\""
Sep 17 16:01:53.344619 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.344591    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:01:53.441911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.441880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.441911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.441917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.442158 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.441960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-987vt\" (UniqueName: \"kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.449339 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.449311    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerID="a318d06aca2122457969f5d8271dd12b51460aeb22132c118e5fd8c502a7c06f" exitCode=2
Sep 17 16:01:53.449459 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.449362    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerDied","Data":"a318d06aca2122457969f5d8271dd12b51460aeb22132c118e5fd8c502a7c06f"}
Sep 17 16:01:53.543444 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.543402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.543608 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.543466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-987vt\" (UniqueName: \"kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.543608 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.543540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.543743 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:01:53.543653    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-923c8-predictor-serving-cert: secret "error-404-isvc-923c8-predictor-serving-cert" not found
Sep 17 16:01:53.543743 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:01:53.543726    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls podName:e4d32368-3c97-4174-9e4e-f433de12df6d nodeName:}" failed. No retries permitted until 2026-09-17 16:01:54.043705816 +0000 UTC m=+1380.723312562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls") pod "error-404-isvc-923c8-predictor-6f56548547-8fjgs" (UID: "e4d32368-3c97-4174-9e4e-f433de12df6d") : secret "error-404-isvc-923c8-predictor-serving-cert" not found
Sep 17 16:01:53.544075 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.544053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:53.555913 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:53.555882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-987vt\" (UniqueName: \"kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:54.047402 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:54.047358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:54.049852 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:54.049830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") pod \"error-404-isvc-923c8-predictor-6f56548547-8fjgs\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") " pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:54.246605 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:54.246572    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:54.535943 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:54.535905    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:01:54.538109 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:01:54.538085    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d32368_3c97_4174_9e4e_f433de12df6d.slice/crio-77bd1af8e034e1505c2ed75e6a4bde759aa0f207f5c040879cdbfe0d3f98bb67 WatchSource:0}: Error finding container 77bd1af8e034e1505c2ed75e6a4bde759aa0f207f5c040879cdbfe0d3f98bb67: Status 404 returned error can't find the container with id 77bd1af8e034e1505c2ed75e6a4bde759aa0f207f5c040879cdbfe0d3f98bb67
Sep 17 16:01:55.235403 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.235377    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:01:55.458692 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.458654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerStarted","Data":"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"}
Sep 17 16:01:55.458888 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.458721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerStarted","Data":"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"}
Sep 17 16:01:55.458888 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.458749    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerStarted","Data":"77bd1af8e034e1505c2ed75e6a4bde759aa0f207f5c040879cdbfe0d3f98bb67"}
Sep 17 16:01:55.458888 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.458795    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:55.497048 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.496946    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podStartSLOduration=2.496929858 podStartE2EDuration="2.496929858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:01:55.495828276 +0000 UTC m=+1382.175435044" watchObservedRunningTime="2026-09-17 16:01:55.496929858 +0000 UTC m=+1382.176536612"
Sep 17 16:01:55.575690 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.575659    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:55.676646 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:55.676613    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:56.466413 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.466378    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerID="9c6d91d8cc25cd5a18e9bef56d99dd475263d9a630ee23ed04e77d2e1a240208" exitCode=0
Sep 17 16:01:56.466760 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.466443    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerDied","Data":"9c6d91d8cc25cd5a18e9bef56d99dd475263d9a630ee23ed04e77d2e1a240208"}
Sep 17 16:01:56.466760 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.466747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:01:56.467996 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.467975    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:01:56.484873 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.484844    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:01:56.565204 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.565117    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsql7\" (UniqueName: \"kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7\") pod \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") "
Sep 17 16:01:56.565204 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.565179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config\") pod \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") "
Sep 17 16:01:56.565204 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.565204    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") pod \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\" (UID: \"bc4f392b-f2e2-4736-acca-e24b9dc3ad48\") "
Sep 17 16:01:56.565634 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.565600    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bc4f392b-f2e2-4736-acca-e24b9dc3ad48" (UID: "bc4f392b-f2e2-4736-acca-e24b9dc3ad48"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:01:56.567494 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.567466    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7" (OuterVolumeSpecName: "kube-api-access-vsql7") pod "bc4f392b-f2e2-4736-acca-e24b9dc3ad48" (UID: "bc4f392b-f2e2-4736-acca-e24b9dc3ad48"). InnerVolumeSpecName "kube-api-access-vsql7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:01:56.567588 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.567499    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bc4f392b-f2e2-4736-acca-e24b9dc3ad48" (UID: "bc4f392b-f2e2-4736-acca-e24b9dc3ad48"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:01:56.666540 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.666510    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:56.666540 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.666533    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:56.666540 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.666544    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsql7\" (UniqueName: \"kubernetes.io/projected/bc4f392b-f2e2-4736-acca-e24b9dc3ad48-kube-api-access-vsql7\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:01:56.917757 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:56.917677    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:57.068111 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.068077    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:01:57.472596 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.472568    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"
Sep 17 16:01:57.473058 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.472604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6" event={"ID":"bc4f392b-f2e2-4736-acca-e24b9dc3ad48","Type":"ContainerDied","Data":"39c5315229e8ed728786af0e211a4366c6328ebe622eb44d424ec07c568754a1"}
Sep 17 16:01:57.473058 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.472677    2568 scope.go:117] "RemoveContainer" containerID="a318d06aca2122457969f5d8271dd12b51460aeb22132c118e5fd8c502a7c06f"
Sep 17 16:01:57.473389 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.473356    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:01:57.481964 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.481947    2568 scope.go:117] "RemoveContainer" containerID="9c6d91d8cc25cd5a18e9bef56d99dd475263d9a630ee23ed04e77d2e1a240208"
Sep 17 16:01:57.494616 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.494597    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:01:57.502642 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.502622    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-efa50-predictor-66b96c7d87-5s7k6"]
Sep 17 16:01:57.836015 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:01:57.835934    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" path="/var/lib/kubelet/pods/bc4f392b-f2e2-4736-acca-e24b9dc3ad48/volumes"
Sep 17 16:02:02.482229 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:02.482203    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:02:02.482670 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:02.482637    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:02:12.483054 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:12.483009    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:02:22.483490 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:22.483447    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:02:32.482762 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:32.482715    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 16:02:42.483212 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:42.483177    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:02:53.283686 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:53.283594    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:02:53.374979 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:02:53.374943    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:03:06.102618 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:03:06.102577    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:03:53.842827 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:03:53.842795    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:03:53.843898 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:03:53.843875    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:04:54.921284 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:04:54.921248    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:04:57.080356 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:04:57.080319    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:07:21.492987 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:07:21.492903    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:08:24.686919 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:08:24.686849    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:08:53.867098 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:08:53.867069    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:08:53.869609 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:08:53.869587    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:10:11.622131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.622091    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:10:11.847186 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.847157    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:10:11.847415 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.847391    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container" containerID="cri-o://71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560" gracePeriod=30
Sep 17 16:10:11.847478 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.847424    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kube-rbac-proxy" containerID="cri-o://7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8" gracePeriod=30
Sep 17 16:10:11.939386 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939305    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:10:11.939644 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939631    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kube-rbac-proxy"
Sep 17 16:10:11.939734 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939647    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kube-rbac-proxy"
Sep 17 16:10:11.939734 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939668    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container"
Sep 17 16:10:11.939734 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939674    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container"
Sep 17 16:10:11.939734 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939727    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kserve-container"
Sep 17 16:10:11.939857 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.939741    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4f392b-f2e2-4736-acca-e24b9dc3ad48" containerName="kube-rbac-proxy"
Sep 17 16:10:11.942474 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.942459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:11.944696 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.944673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5a441-predictor-serving-cert\""
Sep 17 16:10:11.944869 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.944849    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5a441-kube-rbac-proxy-sar-config\""
Sep 17 16:10:11.956520 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.956495    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:10:11.967847 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.967824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:11.967943 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.967861    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthrd\" (UniqueName: \"kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:11.967943 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:11.967886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.069246 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.069208    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.069446 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.069252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nthrd\" (UniqueName: \"kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.069446 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.069290    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.069446 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:10:12.069387    2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-5a441-predictor-serving-cert: secret "error-404-isvc-5a441-predictor-serving-cert" not found
Sep 17 16:10:12.069582 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:10:12.069460    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls podName:997fb04e-4043-4512-a02b-58f3fb11d9ae nodeName:}" failed. No retries permitted until 2026-09-17 16:10:12.569445684 +0000 UTC m=+1879.249052416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls") pod "error-404-isvc-5a441-predictor-5757dccc99-vspdd" (UID: "997fb04e-4043-4512-a02b-58f3fb11d9ae") : secret "error-404-isvc-5a441-predictor-serving-cert" not found
Sep 17 16:10:12.070046 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.070023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.089711 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.089675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthrd\" (UniqueName: \"kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.505898 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.505861    2568 generic.go:356] "Generic (PLEG): container finished" podID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerID="7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8" exitCode=2
Sep 17 16:10:12.506058 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.505931    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerDied","Data":"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"}
Sep 17 16:10:12.571979 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.571945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.574485 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.574464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") pod \"error-404-isvc-5a441-predictor-5757dccc99-vspdd\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") " pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:12.852052 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:12.851960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:13.140584 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.140505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:10:13.143525 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:10:13.143496    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997fb04e_4043_4512_a02b_58f3fb11d9ae.slice/crio-a5d977c4ed54093ec93b986d1b97ec5c41fd74331452f3e35e1add275a1c96a6 WatchSource:0}: Error finding container a5d977c4ed54093ec93b986d1b97ec5c41fd74331452f3e35e1add275a1c96a6: Status 404 returned error can't find the container with id a5d977c4ed54093ec93b986d1b97ec5c41fd74331452f3e35e1add275a1c96a6
Sep 17 16:10:13.170825 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.170795    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:10:13.512256 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.512220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerStarted","Data":"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"}
Sep 17 16:10:13.512485 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.512308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerStarted","Data":"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"}
Sep 17 16:10:13.512485 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.512331    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerStarted","Data":"a5d977c4ed54093ec93b986d1b97ec5c41fd74331452f3e35e1add275a1c96a6"}
Sep 17 16:10:13.512485 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:13.512386    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:14.516329 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:14.516240    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:14.517473 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:14.517439    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:10:15.086768 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.086744    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:10:15.110289 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.110104    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podStartSLOduration=4.110088265 podStartE2EDuration="4.110088265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:10:13.54548643 +0000 UTC m=+1880.225093185" watchObservedRunningTime="2026-09-17 16:10:15.110088265 +0000 UTC m=+1881.789695019"
Sep 17 16:10:15.195577 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.195482    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config\") pod \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") "
Sep 17 16:10:15.195577 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.195560    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt82r\" (UniqueName: \"kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r\") pod \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") "
Sep 17 16:10:15.195792 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.195603    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls\") pod \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\" (UID: \"607017b1-f5c6-4e2b-ac46-dcb22939cc56\") "
Sep 17 16:10:15.195921 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.195882    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "607017b1-f5c6-4e2b-ac46-dcb22939cc56" (UID: "607017b1-f5c6-4e2b-ac46-dcb22939cc56"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:10:15.197785 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.197760    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "607017b1-f5c6-4e2b-ac46-dcb22939cc56" (UID: "607017b1-f5c6-4e2b-ac46-dcb22939cc56"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:10:15.197898 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.197852    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r" (OuterVolumeSpecName: "kube-api-access-pt82r") pod "607017b1-f5c6-4e2b-ac46-dcb22939cc56" (UID: "607017b1-f5c6-4e2b-ac46-dcb22939cc56"). InnerVolumeSpecName "kube-api-access-pt82r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:10:15.296837 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.296805    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt82r\" (UniqueName: \"kubernetes.io/projected/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-api-access-pt82r\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:10:15.296837 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.296829    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/607017b1-f5c6-4e2b-ac46-dcb22939cc56-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:10:15.296837 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.296841    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/607017b1-f5c6-4e2b-ac46-dcb22939cc56-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:10:15.521690 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.521659    2568 generic.go:356] "Generic (PLEG): container finished" podID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerID="71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560" exitCode=0
Sep 17 16:10:15.522131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.521713    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"
Sep 17 16:10:15.522131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.521733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerDied","Data":"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"}
Sep 17 16:10:15.522131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.521798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf" event={"ID":"607017b1-f5c6-4e2b-ac46-dcb22939cc56","Type":"ContainerDied","Data":"13ab5cd143a69cfe6b7226768027820708278b21363a24a5881bb9050ae68511"}
Sep 17 16:10:15.522131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.521825    2568 scope.go:117] "RemoveContainer" containerID="7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"
Sep 17 16:10:15.522700 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.522667    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:10:15.530518 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.530503    2568 scope.go:117] "RemoveContainer" containerID="71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"
Sep 17 16:10:15.537792 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.537771    2568 scope.go:117] "RemoveContainer" containerID="7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"
Sep 17 16:10:15.538031 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:10:15.538014    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8\": container with ID starting with 7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8 not found: ID does not exist" containerID="7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"
Sep 17 16:10:15.538080 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.538042    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8"} err="failed to get container status \"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8\": rpc error: code = NotFound desc = could not find container \"7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8\": container with ID starting with 7652d8d7e2b241de1179c891afcb3d57df18627aa342002c5efcf8dedd9529e8 not found: ID does not exist"
Sep 17 16:10:15.538080 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.538063    2568 scope.go:117] "RemoveContainer" containerID="71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"
Sep 17 16:10:15.538311 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:10:15.538293    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560\": container with ID starting with 71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560 not found: ID does not exist" containerID="71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"
Sep 17 16:10:15.538359 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.538318    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560"} err="failed to get container status \"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560\": rpc error: code = NotFound desc = could not find container \"71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560\": container with ID starting with 71ac2eb1da27ac43cfc206f43fdd248f0043ab79ca5be6698d4d3bc5b8425560 not found: ID does not exist"
Sep 17 16:10:15.545362 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.545338    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:10:15.551001 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.550980    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bfbea-predictor-858c7548df-d6twf"]
Sep 17 16:10:15.835617 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:15.835538    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" path="/var/lib/kubelet/pods/607017b1-f5c6-4e2b-ac46-dcb22939cc56/volumes"
Sep 17 16:10:20.526942 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:20.526915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:10:20.527465 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:20.527438    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:10:24.464945 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:24.464911    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:10:30.528419 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:30.528372    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:10:40.527687 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:40.527641    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:10:50.528029 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:10:50.527992    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 16:11:00.528447 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:00.528413    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:11:07.876582 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:07.876553    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.014980 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.014938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.030429 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.030402    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:11:08.030648 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.030621    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container" containerID="cri-o://af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3" gracePeriod=30
Sep 17 16:11:08.030786 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.030648    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kube-rbac-proxy" containerID="cri-o://adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388" gracePeriod=30
Sep 17 16:11:08.124662 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.124630    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.223324 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.223293    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.280779 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.280738    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:11:08.281191 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281177    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container"
Sep 17 16:11:08.281233 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281195    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container"
Sep 17 16:11:08.281233 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281207    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kube-rbac-proxy"
Sep 17 16:11:08.281233 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281215    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kube-rbac-proxy"
Sep 17 16:11:08.281388 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281304    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kserve-container"
Sep 17 16:11:08.281388 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.281318    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="607017b1-f5c6-4e2b-ac46-dcb22939cc56" containerName="kube-rbac-proxy"
Sep 17 16:11:08.284640 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.284623    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.287461 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.287435    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ece61-kube-rbac-proxy-sar-config\""
Sep 17 16:11:08.287615 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.287588    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ece61-predictor-serving-cert\""
Sep 17 16:11:08.300021 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.299997    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:11:08.308695 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.308673    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.388647 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.388613    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.388815 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.388651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.388815 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.388678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfz2d\" (UniqueName: \"kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.424107 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.424036    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.489110 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.489080    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfz2d\" (UniqueName: \"kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.489235 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.489146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.489235 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.489171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.489790 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.489768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.491849 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.491829    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.501534 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.501512    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfz2d\" (UniqueName: \"kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d\") pod \"error-404-isvc-ece61-predictor-c968b59fc-7nl56\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") " pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.525398 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.525370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:08.595411 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.595383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:08.747947 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.747916    2568 generic.go:356] "Generic (PLEG): container finished" podID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerID="adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388" exitCode=2
Sep 17 16:11:08.748106 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.747953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerDied","Data":"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"}
Sep 17 16:11:08.879267 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:08.879230    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:11:08.884877 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:11:08.884850    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb2ca32_907f_4149_99a4_93e0b2abc419.slice/crio-ddbd4eeae4f8e716999070cf9705b0623a92076d4d4c059c428954982d7ffa39 WatchSource:0}: Error finding container ddbd4eeae4f8e716999070cf9705b0623a92076d4d4c059c428954982d7ffa39: Status 404 returned error can't find the container with id ddbd4eeae4f8e716999070cf9705b0623a92076d4d4c059c428954982d7ffa39
Sep 17 16:11:09.759562 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:09.759522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerStarted","Data":"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"}
Sep 17 16:11:09.759742 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:09.759605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerStarted","Data":"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"}
Sep 17 16:11:09.759742 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:09.759632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerStarted","Data":"ddbd4eeae4f8e716999070cf9705b0623a92076d4d4c059c428954982d7ffa39"}
Sep 17 16:11:09.759742 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:09.759665    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:09.788987 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:09.788932    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podStartSLOduration=1.7889161470000001 podStartE2EDuration="1.788916147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:11:09.786918029 +0000 UTC m=+1936.466524795" watchObservedRunningTime="2026-09-17 16:11:09.788916147 +0000 UTC m=+1936.468522903"
Sep 17 16:11:10.764641 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:10.764600    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:10.765873 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:10.765836    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:11.272942 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.272920    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:11:11.416664 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.416571    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") pod \"e4d32368-3c97-4174-9e4e-f433de12df6d\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") "
Sep 17 16:11:11.416664 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.416610    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config\") pod \"e4d32368-3c97-4174-9e4e-f433de12df6d\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") "
Sep 17 16:11:11.416664 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.416666    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-987vt\" (UniqueName: \"kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt\") pod \"e4d32368-3c97-4174-9e4e-f433de12df6d\" (UID: \"e4d32368-3c97-4174-9e4e-f433de12df6d\") "
Sep 17 16:11:11.417011 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.416972    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e4d32368-3c97-4174-9e4e-f433de12df6d" (UID: "e4d32368-3c97-4174-9e4e-f433de12df6d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:11:11.418864 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.418842    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e4d32368-3c97-4174-9e4e-f433de12df6d" (UID: "e4d32368-3c97-4174-9e4e-f433de12df6d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:11:11.418945 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.418894    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt" (OuterVolumeSpecName: "kube-api-access-987vt") pod "e4d32368-3c97-4174-9e4e-f433de12df6d" (UID: "e4d32368-3c97-4174-9e4e-f433de12df6d"). InnerVolumeSpecName "kube-api-access-987vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:11:11.517568 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.517520    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-987vt\" (UniqueName: \"kubernetes.io/projected/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-api-access-987vt\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:11.517568 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.517562    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d32368-3c97-4174-9e4e-f433de12df6d-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:11.517568 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.517572    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e4d32368-3c97-4174-9e4e-f433de12df6d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:11.771205 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.771170    2568 generic.go:356] "Generic (PLEG): container finished" podID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerID="af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3" exitCode=0
Sep 17 16:11:11.771697 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.771215    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerDied","Data":"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"}
Sep 17 16:11:11.771697 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.771225    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"
Sep 17 16:11:11.771697 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.771313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs" event={"ID":"e4d32368-3c97-4174-9e4e-f433de12df6d","Type":"ContainerDied","Data":"77bd1af8e034e1505c2ed75e6a4bde759aa0f207f5c040879cdbfe0d3f98bb67"}
Sep 17 16:11:11.771697 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.771360    2568 scope.go:117] "RemoveContainer" containerID="adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"
Sep 17 16:11:11.772242 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.772212    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:11.781422 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.781401    2568 scope.go:117] "RemoveContainer" containerID="af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"
Sep 17 16:11:11.788998 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.788976    2568 scope.go:117] "RemoveContainer" containerID="adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"
Sep 17 16:11:11.789255 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:11:11.789235    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388\": container with ID starting with adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388 not found: ID does not exist" containerID="adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"
Sep 17 16:11:11.789343 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.789261    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388"} err="failed to get container status \"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388\": rpc error: code = NotFound desc = could not find container \"adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388\": container with ID starting with adf6c07f21ab901e113aa49b69744d668901e621c1f483dca326fb8f1b630388 not found: ID does not exist"
Sep 17 16:11:11.789343 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.789297    2568 scope.go:117] "RemoveContainer" containerID="af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"
Sep 17 16:11:11.789562 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:11:11.789545    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3\": container with ID starting with af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3 not found: ID does not exist" containerID="af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"
Sep 17 16:11:11.789606 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.789568    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3"} err="failed to get container status \"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3\": rpc error: code = NotFound desc = could not find container \"af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3\": container with ID starting with af050a12269e4fa147dd6db5fba56b14206fe3dd3bc8028185910f52fe4107c3 not found: ID does not exist"
Sep 17 16:11:11.799186 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.799165    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:11:11.806172 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.806146    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-923c8-predictor-6f56548547-8fjgs"]
Sep 17 16:11:11.817268 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.817244    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:11.835760 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.835738    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" path="/var/lib/kubelet/pods/e4d32368-3c97-4174-9e4e-f433de12df6d/volumes"
Sep 17 16:11:11.909615 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:11.909578    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:16.775938 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:16.775913    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:11:16.776350 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:16.776299    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:22.020393 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.020328    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.258068 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.258034    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.368827 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.368745    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:11:22.369011 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.368985    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container" containerID="cri-o://e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a" gracePeriod=30
Sep 17 16:11:22.369094 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.369023    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kube-rbac-proxy" containerID="cri-o://e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353" gracePeriod=30
Sep 17 16:11:22.404155 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.404129    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.529747 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.529709    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.560627 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560590    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:11:22.560903 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560891    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container"
Sep 17 16:11:22.560946 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560905    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container"
Sep 17 16:11:22.560946 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560924    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kube-rbac-proxy"
Sep 17 16:11:22.560946 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560929    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kube-rbac-proxy"
Sep 17 16:11:22.561033 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560974    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kube-rbac-proxy"
Sep 17 16:11:22.561033 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.560982    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d32368-3c97-4174-9e4e-f433de12df6d" containerName="kserve-container"
Sep 17 16:11:22.563925 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.563907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.571466 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.571447    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8fed6-predictor-serving-cert\""
Sep 17 16:11:22.573052 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.573035    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8fed6-kube-rbac-proxy-sar-config\""
Sep 17 16:11:22.590401 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.590372    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:11:22.590493 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.590454    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.590544 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.590492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.590579 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.590549    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfzn\" (UniqueName: \"kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.643327 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.643243    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.691750 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.691715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.691911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.691766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.691911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.691813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfzn\" (UniqueName: \"kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.692466 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.692447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.694407 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.694384    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.709499 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.709480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfzn\" (UniqueName: \"kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn\") pod \"error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") " pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:22.760811 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.760782    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:11:22.828296 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.828246    2568 generic.go:356] "Generic (PLEG): container finished" podID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerID="e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353" exitCode=2
Sep 17 16:11:22.828458 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.828308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerDied","Data":"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"}
Sep 17 16:11:22.873948 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:22.873913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:23.159252 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.159221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:11:23.161358 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:11:23.161325    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a23384e_6ee0_47c1_a802_c12148d85b45.slice/crio-c5e31248c4ee87f9d9eaa446625a8378dbe1831ff6ba474c61046fef52dcd4b8 WatchSource:0}: Error finding container c5e31248c4ee87f9d9eaa446625a8378dbe1831ff6ba474c61046fef52dcd4b8: Status 404 returned error can't find the container with id c5e31248c4ee87f9d9eaa446625a8378dbe1831ff6ba474c61046fef52dcd4b8
Sep 17 16:11:23.835237 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.835205    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerStarted","Data":"c6040bb62e23f40fe08c5e83d0ad6afae592dda311f4490cc4f5ed558ee15895"}
Sep 17 16:11:23.835420 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.835264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:23.835420 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.835316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerStarted","Data":"bd83678dbecf6235898cd853f46c7f300ccdb328ae1302469a1522ddaf9bff07"}
Sep 17 16:11:23.835420 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.835338    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerStarted","Data":"c5e31248c4ee87f9d9eaa446625a8378dbe1831ff6ba474c61046fef52dcd4b8"}
Sep 17 16:11:23.867714 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:23.867647    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podStartSLOduration=1.8676319590000001 podStartE2EDuration="1.867631959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:11:23.867228869 +0000 UTC m=+1950.546835625" watchObservedRunningTime="2026-09-17 16:11:23.867631959 +0000 UTC m=+1950.547238714"
Sep 17 16:11:24.839403 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:24.839367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:24.840725 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:24.840697    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:11:25.523185 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.523143    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused"
Sep 17 16:11:25.615646 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.615620    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:11:25.714925 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.714845    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") pod \"997fb04e-4043-4512-a02b-58f3fb11d9ae\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") "
Sep 17 16:11:25.714925 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.714886    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config\") pod \"997fb04e-4043-4512-a02b-58f3fb11d9ae\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") "
Sep 17 16:11:25.715116 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.714942    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nthrd\" (UniqueName: \"kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd\") pod \"997fb04e-4043-4512-a02b-58f3fb11d9ae\" (UID: \"997fb04e-4043-4512-a02b-58f3fb11d9ae\") "
Sep 17 16:11:25.715321 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.715294    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "997fb04e-4043-4512-a02b-58f3fb11d9ae" (UID: "997fb04e-4043-4512-a02b-58f3fb11d9ae"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:11:25.717196 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.717170    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd" (OuterVolumeSpecName: "kube-api-access-nthrd") pod "997fb04e-4043-4512-a02b-58f3fb11d9ae" (UID: "997fb04e-4043-4512-a02b-58f3fb11d9ae"). InnerVolumeSpecName "kube-api-access-nthrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:11:25.717196 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.717184    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "997fb04e-4043-4512-a02b-58f3fb11d9ae" (UID: "997fb04e-4043-4512-a02b-58f3fb11d9ae"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:11:25.815348 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.815305    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/997fb04e-4043-4512-a02b-58f3fb11d9ae-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:25.815348 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.815341    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:25.815348 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.815354    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nthrd\" (UniqueName: \"kubernetes.io/projected/997fb04e-4043-4512-a02b-58f3fb11d9ae-kube-api-access-nthrd\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:11:25.844729 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.844700    2568 generic.go:356] "Generic (PLEG): container finished" podID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerID="e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a" exitCode=0
Sep 17 16:11:25.845035 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.844746    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"
Sep 17 16:11:25.845035 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.844781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerDied","Data":"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"}
Sep 17 16:11:25.845035 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.844838    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd" event={"ID":"997fb04e-4043-4512-a02b-58f3fb11d9ae","Type":"ContainerDied","Data":"a5d977c4ed54093ec93b986d1b97ec5c41fd74331452f3e35e1add275a1c96a6"}
Sep 17 16:11:25.845035 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.844863    2568 scope.go:117] "RemoveContainer" containerID="e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"
Sep 17 16:11:25.845526 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.845490    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:11:25.852925 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.852908    2568 scope.go:117] "RemoveContainer" containerID="e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"
Sep 17 16:11:25.861628 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.861604    2568 scope.go:117] "RemoveContainer" containerID="e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"
Sep 17 16:11:25.861916 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:11:25.861898    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353\": container with ID starting with e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353 not found: ID does not exist" containerID="e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"
Sep 17 16:11:25.862001 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.861927    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353"} err="failed to get container status \"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353\": rpc error: code = NotFound desc = could not find container \"e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353\": container with ID starting with e825d31bca6f67148cee04b351079d866dcd18867f80f3fdfac15a5cb5b4c353 not found: ID does not exist"
Sep 17 16:11:25.862001 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.861951    2568 scope.go:117] "RemoveContainer" containerID="e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"
Sep 17 16:11:25.862338 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:11:25.862314    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a\": container with ID starting with e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a not found: ID does not exist" containerID="e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"
Sep 17 16:11:25.862409 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.862347    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a"} err="failed to get container status \"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a\": rpc error: code = NotFound desc = could not find container \"e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a\": container with ID starting with e2eb7405b5a558b60d9531294c9e95e0004ace0fa67f2e270feddf063e12b87a not found: ID does not exist"
Sep 17 16:11:25.869335 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.869302    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:11:25.873076 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:25.873055    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5a441-predictor-5757dccc99-vspdd"]
Sep 17 16:11:26.776449 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:26.776409    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:27.835224 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:27.835193    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" path="/var/lib/kubelet/pods/997fb04e-4043-4512-a02b-58f3fb11d9ae/volumes"
Sep 17 16:11:30.850214 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:30.850185    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:11:30.850835 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:30.850805    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:11:36.776490 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:36.776447    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:40.851500 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:40.851464    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:11:46.776942 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:46.776848    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 16:11:50.851551 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:50.851507    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:11:56.777172 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:11:56.777141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:12:00.851553 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:00.851509    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 16:12:08.145573 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:08.145539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:12:08.390027 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:08.389993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:12:10.852131 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:10.852094    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:12:22.365698 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:22.365661    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:12:22.758185 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:12:22.758152    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:13:53.891606 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:13:53.891574    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:13:53.894155 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:13:53.894131    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:14:44.407546 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:14:44.407508    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:14:54.629715 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:14:54.629679    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:16:22.742982 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:16:22.742903    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:18:53.917565 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:18:53.917533    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:18:53.919923 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:18:53.919890    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:20:29.215998 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:29.215964    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:20:37.002594 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.002539    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:20:37.167048 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.166993    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:20:37.181492 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.181468    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:20:37.181694 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.181672    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container" containerID="cri-o://bd83678dbecf6235898cd853f46c7f300ccdb328ae1302469a1522ddaf9bff07" gracePeriod=30
Sep 17 16:20:37.181761 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.181709    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kube-rbac-proxy" containerID="cri-o://c6040bb62e23f40fe08c5e83d0ad6afae592dda311f4490cc4f5ed558ee15895" gracePeriod=30
Sep 17 16:20:37.242094 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:37.242062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:20:38.110556 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:38.110518    2568 generic.go:356] "Generic (PLEG): container finished" podID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerID="c6040bb62e23f40fe08c5e83d0ad6afae592dda311f4490cc4f5ed558ee15895" exitCode=2
Sep 17 16:20:38.110966 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:38.110596    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerDied","Data":"c6040bb62e23f40fe08c5e83d0ad6afae592dda311f4490cc4f5ed558ee15895"}
Sep 17 16:20:40.120885 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.120849    2568 generic.go:356] "Generic (PLEG): container finished" podID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerID="bd83678dbecf6235898cd853f46c7f300ccdb328ae1302469a1522ddaf9bff07" exitCode=0
Sep 17 16:20:40.121337 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.120919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerDied","Data":"bd83678dbecf6235898cd853f46c7f300ccdb328ae1302469a1522ddaf9bff07"}
Sep 17 16:20:40.234214 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.234191    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:20:40.351904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.351809    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls\") pod \"5a23384e-6ee0-47c1-a802-c12148d85b45\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") "
Sep 17 16:20:40.351904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.351868    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config\") pod \"5a23384e-6ee0-47c1-a802-c12148d85b45\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") "
Sep 17 16:20:40.351904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.351893    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znfzn\" (UniqueName: \"kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn\") pod \"5a23384e-6ee0-47c1-a802-c12148d85b45\" (UID: \"5a23384e-6ee0-47c1-a802-c12148d85b45\") "
Sep 17 16:20:40.352217 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.352192    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5a23384e-6ee0-47c1-a802-c12148d85b45" (UID: "5a23384e-6ee0-47c1-a802-c12148d85b45"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:20:40.354123 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.354097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn" (OuterVolumeSpecName: "kube-api-access-znfzn") pod "5a23384e-6ee0-47c1-a802-c12148d85b45" (UID: "5a23384e-6ee0-47c1-a802-c12148d85b45"). InnerVolumeSpecName "kube-api-access-znfzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:20:40.354212 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.354121    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5a23384e-6ee0-47c1-a802-c12148d85b45" (UID: "5a23384e-6ee0-47c1-a802-c12148d85b45"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:20:40.452787 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.452748    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a23384e-6ee0-47c1-a802-c12148d85b45-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:20:40.452787 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.452785    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:20:40.452787 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:40.452796    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znfzn\" (UniqueName: \"kubernetes.io/projected/5a23384e-6ee0-47c1-a802-c12148d85b45-kube-api-access-znfzn\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:20:41.127106 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.127058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx" event={"ID":"5a23384e-6ee0-47c1-a802-c12148d85b45","Type":"ContainerDied","Data":"c5e31248c4ee87f9d9eaa446625a8378dbe1831ff6ba474c61046fef52dcd4b8"}
Sep 17 16:20:41.127601 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.127128    2568 scope.go:117] "RemoveContainer" containerID="c6040bb62e23f40fe08c5e83d0ad6afae592dda311f4490cc4f5ed558ee15895"
Sep 17 16:20:41.127601 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.127079    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"
Sep 17 16:20:41.137724 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.137706    2568 scope.go:117] "RemoveContainer" containerID="bd83678dbecf6235898cd853f46c7f300ccdb328ae1302469a1522ddaf9bff07"
Sep 17 16:20:41.159843 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.159817    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:20:41.165556 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.165532    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fed6-predictor-7bdf47c69f-8s4xx"]
Sep 17 16:20:41.835567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:20:41.835536    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" path="/var/lib/kubelet/pods/5a23384e-6ee0-47c1-a802-c12148d85b45/volumes"
Sep 17 16:21:00.275618 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:21:00.275582    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:23:53.939465 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:23:53.939388    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:23:53.946157 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:23:53.946139    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:23:54.612953 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:23:54.612921    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:24:43.597285 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:24:43.597201    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:27.529618 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.529534    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:27.625659 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.625619    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:27.639623 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.639581    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:28:27.639898 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.639876    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container" containerID="cri-o://4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb" gracePeriod=30
Sep 17 16:28:27.639996 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.639895    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kube-rbac-proxy" containerID="cri-o://159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918" gracePeriod=30
Sep 17 16:28:27.693498 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.693443    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:27.864459 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.864345    2568 generic.go:356] "Generic (PLEG): container finished" podID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerID="159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918" exitCode=2
Sep 17 16:28:27.864459 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:27.864422    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerDied","Data":"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"}
Sep 17 16:28:28.936067 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:28.936019    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:29.010743 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:29.010707    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:28:30.777418 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.777393    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:28:30.878126 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.878049    2568 generic.go:356] "Generic (PLEG): container finished" podID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerID="4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb" exitCode=0
Sep 17 16:28:30.878126 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.878083    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerDied","Data":"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"}
Sep 17 16:28:30.878126 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.878101    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"
Sep 17 16:28:30.878126 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.878127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56" event={"ID":"4eb2ca32-907f-4149-99a4-93e0b2abc419","Type":"ContainerDied","Data":"ddbd4eeae4f8e716999070cf9705b0623a92076d4d4c059c428954982d7ffa39"}
Sep 17 16:28:30.878461 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.878152    2568 scope.go:117] "RemoveContainer" containerID="159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"
Sep 17 16:28:30.884452 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.884432    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls\") pod \"4eb2ca32-907f-4149-99a4-93e0b2abc419\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") "
Sep 17 16:28:30.884577 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.884469    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfz2d\" (UniqueName: \"kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d\") pod \"4eb2ca32-907f-4149-99a4-93e0b2abc419\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") "
Sep 17 16:28:30.884577 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.884527    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config\") pod \"4eb2ca32-907f-4149-99a4-93e0b2abc419\" (UID: \"4eb2ca32-907f-4149-99a4-93e0b2abc419\") "
Sep 17 16:28:30.885013 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.884985    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4eb2ca32-907f-4149-99a4-93e0b2abc419" (UID: "4eb2ca32-907f-4149-99a4-93e0b2abc419"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:28:30.886703 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.886685    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4eb2ca32-907f-4149-99a4-93e0b2abc419" (UID: "4eb2ca32-907f-4149-99a4-93e0b2abc419"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:30.887113 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.887091    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d" (OuterVolumeSpecName: "kube-api-access-rfz2d") pod "4eb2ca32-907f-4149-99a4-93e0b2abc419" (UID: "4eb2ca32-907f-4149-99a4-93e0b2abc419"). InnerVolumeSpecName "kube-api-access-rfz2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:28:30.887607 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.887588    2568 scope.go:117] "RemoveContainer" containerID="4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"
Sep 17 16:28:30.899132 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.899115    2568 scope.go:117] "RemoveContainer" containerID="159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"
Sep 17 16:28:30.899414 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:28:30.899398    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918\": container with ID starting with 159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918 not found: ID does not exist" containerID="159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"
Sep 17 16:28:30.899463 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.899422    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918"} err="failed to get container status \"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918\": rpc error: code = NotFound desc = could not find container \"159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918\": container with ID starting with 159677fa086b02edb739b7941f70b3bf68cb831f655cbac73d9cd09729b58918 not found: ID does not exist"
Sep 17 16:28:30.899463 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.899437    2568 scope.go:117] "RemoveContainer" containerID="4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"
Sep 17 16:28:30.899675 ip-10-0-128-116 kubenswrapper[2568]: E0917 16:28:30.899659    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb\": container with ID starting with 4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb not found: ID does not exist" containerID="4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"
Sep 17 16:28:30.899715 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.899685    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb"} err="failed to get container status \"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb\": rpc error: code = NotFound desc = could not find container \"4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb\": container with ID starting with 4f9f82fab81ba8b72714a3651a9e1145c94c6e2c1083d7f42605b2116c9d60bb not found: ID does not exist"
Sep 17 16:28:30.985207 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.985175    2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4eb2ca32-907f-4149-99a4-93e0b2abc419-proxy-tls\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:28:30.985207 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.985203    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfz2d\" (UniqueName: \"kubernetes.io/projected/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-api-access-rfz2d\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:28:30.985207 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:30.985214    2568 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4eb2ca32-907f-4149-99a4-93e0b2abc419-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-116.ec2.internal\" DevicePath \"\""
Sep 17 16:28:31.200528 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:31.200495    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:28:31.206925 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:31.206896    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ece61-predictor-c968b59fc-7nl56"]
Sep 17 16:28:31.834586 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:31.834553    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" path="/var/lib/kubelet/pods/4eb2ca32-907f-4149-99a4-93e0b2abc419/volumes"
Sep 17 16:28:53.965911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:53.965874    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:28:53.970642 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:28:53.970623    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:29:00.717461 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:00.717424    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:29:02.381335 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:02.381300    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:29:04.281314 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:04.281255    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cp9kh_e5647f10-c7b0-4489-bec1-8e1613274f1c/global-pull-secret-syncer/0.log"
Sep 17 16:29:04.405004 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:04.404975    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log"
Sep 17 16:29:04.538259 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:04.538136    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-116.ec2.internal_40c6e7c23f6418e0d386adbda44b2f29/haproxy/0.log"
Sep 17 16:29:06.949671 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:06.949639    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:29:07.047034 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:07.046995    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6dlfh_525abf0e-50e6-41ab-a22e-9ae592828df6/konnectivity-agent/0.log" limit=1024
Sep 17 16:29:09.323843 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:09.323811    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztrf2_39648581-1a0c-4ec2-9fcc-671c9519aec2/node-exporter/0.log"
Sep 17 16:29:09.352501 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:09.352476    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztrf2_39648581-1a0c-4ec2-9fcc-671c9519aec2/kube-rbac-proxy/0.log"
Sep 17 16:29:09.381728 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:09.381709    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztrf2_39648581-1a0c-4ec2-9fcc-671c9519aec2/init-textfile/0.log"
Sep 17 16:29:12.128154 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128121    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"]
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128410    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128421    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128428    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128433    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128447    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128453    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128458    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128463    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128468    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128473    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128478    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128483    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128532    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128539    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128544    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eb2ca32-907f-4149-99a4-93e0b2abc419" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128552    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kserve-container"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128558    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="997fb04e-4043-4512-a02b-58f3fb11d9ae" containerName="kube-rbac-proxy"
Sep 17 16:29:12.128567 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.128564    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a23384e-6ee0-47c1-a802-c12148d85b45" containerName="kube-rbac-proxy"
Sep 17 16:29:12.131482 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.131463    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.133782 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.133761    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72p88\"/\"kube-root-ca.crt\""
Sep 17 16:29:12.134429 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.134411    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72p88\"/\"openshift-service-ca.crt\""
Sep 17 16:29:12.134520 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.134411    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-72p88\"/\"default-dockercfg-vh8vv\""
Sep 17 16:29:12.145388 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.145364    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"]
Sep 17 16:29:12.184555 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.184526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-podres\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.184904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.184565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdglr\" (UniqueName: \"kubernetes.io/projected/cbe09894-9b86-400b-99bd-1b920a334d7f-kube-api-access-fdglr\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.184904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.184594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-proc\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.184904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.184679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-sys\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.184904 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.184725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-lib-modules\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285530 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-podres\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285530 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdglr\" (UniqueName: \"kubernetes.io/projected/cbe09894-9b86-400b-99bd-1b920a334d7f-kube-api-access-fdglr\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-proc\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-sys\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-lib-modules\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285669    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-podres\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285698    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-proc\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285767 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285704    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-sys\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.285968 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.285772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe09894-9b86-400b-99bd-1b920a334d7f-lib-modules\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.295662 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.295627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdglr\" (UniqueName: \"kubernetes.io/projected/cbe09894-9b86-400b-99bd-1b920a334d7f-kube-api-access-fdglr\") pod \"perf-node-gather-daemonset-q5w8h\" (UID: \"cbe09894-9b86-400b-99bd-1b920a334d7f\") " pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.414595 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.414521    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-fgm92_49ff1b3f-5764-43c5-a159-d2df16a51515/download-server/0.log"
Sep 17 16:29:12.441304 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.441261    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:12.716853 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:12.716770    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"]
Sep 17 16:29:12.719759 ip-10-0-128-116 kubenswrapper[2568]: W0917 16:29:12.719732    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbe09894_9b86_400b_99bd_1b920a334d7f.slice/crio-6950aedaaace65828fb0a7529d3db5cf8bd8488ec92d2eb66e7c4b3b17f2d2e3 WatchSource:0}: Error finding container 6950aedaaace65828fb0a7529d3db5cf8bd8488ec92d2eb66e7c4b3b17f2d2e3: Status 404 returned error can't find the container with id 6950aedaaace65828fb0a7529d3db5cf8bd8488ec92d2eb66e7c4b3b17f2d2e3
Sep 17 16:29:13.036218 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:13.036184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h" event={"ID":"cbe09894-9b86-400b-99bd-1b920a334d7f","Type":"ContainerStarted","Data":"29b60031e1559f1af2693d06ce6c0c0c8e8cd544fa4f09927dffbccc476083f3"}
Sep 17 16:29:13.036419 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:13.036235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h" event={"ID":"cbe09894-9b86-400b-99bd-1b920a334d7f","Type":"ContainerStarted","Data":"6950aedaaace65828fb0a7529d3db5cf8bd8488ec92d2eb66e7c4b3b17f2d2e3"}
Sep 17 16:29:13.036419 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:13.036313    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:13.056477 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:13.056438    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h" podStartSLOduration=1.05642403 podStartE2EDuration="1.05642403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:29:13.05632879 +0000 UTC m=+3019.735935545" watchObservedRunningTime="2026-09-17 16:29:13.05642403 +0000 UTC m=+3019.736030784"
Sep 17 16:29:13.069316 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:13.069287    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-f5qzl_541469eb-433f-4128-8a32-b328cf2ce8aa/volume-data-source-validator/0.log"
Sep 17 16:29:14.107559 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:14.107521    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ph4t7_b1932727-7741-4b70-91bb-8267396c5c53/dns/0.log"
Sep 17 16:29:14.134436 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:14.134404    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ph4t7_b1932727-7741-4b70-91bb-8267396c5c53/kube-rbac-proxy/0.log"
Sep 17 16:29:14.279707 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:14.279671    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mpll6_1af148d5-d1b5-4891-8e96-47ec18b6c7d2/dns-node-resolver/0.log"
Sep 17 16:29:14.898478 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:14.898444    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cr8vq_f4f57f74-43a1-4bcb-b9c3-6615e952fb66/node-ca/0.log"
Sep 17 16:29:16.233896 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:16.233870    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-66px2_ac695afb-de8f-412a-971d-1659f018f784/serve-healthcheck-canary/0.log"
Sep 17 16:29:16.858788 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:16.858752    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9nhk_882c93c6-325b-427e-abd5-69797a99f30c/kube-rbac-proxy/0.log"
Sep 17 16:29:16.886926 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:16.886903    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9nhk_882c93c6-325b-427e-abd5-69797a99f30c/exporter/0.log"
Sep 17 16:29:16.913993 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:16.913961    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9nhk_882c93c6-325b-427e-abd5-69797a99f30c/extractor/0.log"
Sep 17 16:29:19.050159 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:19.050128    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-72p88/perf-node-gather-daemonset-q5w8h"
Sep 17 16:29:19.576344 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:19.576313    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-nsbc4_c4813062-3df1-4577-b077-654ceffc8ffc/manager/0.log"
Sep 17 16:29:19.598004 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:19.597979    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-6lzj2_f4206784-e1f4-4c66-a5e2-3209c94a52e0/server/0.log"
Sep 17 16:29:24.432252 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:24.432217    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-rg6bm_ced3b10f-e5e5-4f27-a49e-bf10e4c091e4/migrator/0.log"
Sep 17 16:29:24.457907 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:24.457878    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-rg6bm_ced3b10f-e5e5-4f27-a49e-bf10e4c091e4/graceful-termination/0.log"
Sep 17 16:29:26.218839 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.218810    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/kube-multus-additional-cni-plugins/0.log"
Sep 17 16:29:26.245000 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.244979    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/egress-router-binary-copy/0.log"
Sep 17 16:29:26.277799 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.277773    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/cni-plugins/0.log"
Sep 17 16:29:26.304049 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.304022    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/bond-cni-plugin/0.log"
Sep 17 16:29:26.328908 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.328873    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/routeoverride-cni/0.log"
Sep 17 16:29:26.357136 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.357110    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/whereabouts-cni-bincopy/0.log"
Sep 17 16:29:26.386911 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.386888    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t7kqm_4fe3d781-ec0d-4a72-94d0-a48279ca2fe5/whereabouts-cni/0.log"
Sep 17 16:29:26.469060 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.468978    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jdqlv_a5079592-65f0-4ecc-b6fa-57ea9e4118cd/kube-multus/0.log"
Sep 17 16:29:26.662027 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.661994    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh8lz_1b5dfd7d-176e-47a5-ae63-b04602d0c58e/network-metrics-daemon/0.log"
Sep 17 16:29:26.689669 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:26.689641    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh8lz_1b5dfd7d-176e-47a5-ae63-b04602d0c58e/kube-rbac-proxy/0.log"
Sep 17 16:29:27.842267 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.842235    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-controller/0.log"
Sep 17 16:29:27.863738 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.863697    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/1.log"
Sep 17 16:29:27.863738 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.863732    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovn-acl-logging/0.log"
Sep 17 16:29:27.884908 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.884885    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/kube-rbac-proxy-node/0.log"
Sep 17 16:29:27.908354 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.908332    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 16:29:27.930125 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.930095    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/northd/0.log"
Sep 17 16:29:27.956071 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.956045    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/nbdb/0.log"
Sep 17 16:29:27.981706 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:27.981682    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/sbdb/0.log"
Sep 17 16:29:28.038797 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:28.038745    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9zkq_2127d592-38b5-48ec-854b-628e49ea1bab/ovnkube-controller/0.log"
Sep 17 16:29:29.478354 ip-10-0-128-116 kubenswrapper[2568]: I0917 16:29:29.478319    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pgml8_f7f3419a-e3c5-454d-a120-c7a8843e6e6a/network-check-target-container/0.log"