Sep 16 12:45:56.699316 ip-10-0-131-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 12:45:56.699327 ip-10-0-131-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 12:45:56.699336 ip-10-0-131-158 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 12:45:56.699633 ip-10-0-131-158 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 12:46:06.466243 ip-10-0-131-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 12:46:06.466257 ip-10-0-131-158 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6a483028841e42e39c7deb1792c95d30 --
Sep 16 12:47:36.819121 ip-10-0-131-158 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 12:47:37.264972 ip-10-0-131-158 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:47:37.264972 ip-10-0-131-158 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 12:47:37.264972 ip-10-0-131-158 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:47:37.264972 ip-10-0-131-158 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 12:47:37.264972 ip-10-0-131-158 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:47:37.267119 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.267040    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 12:47:37.271430 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271416    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271431    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271435    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271439    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271442    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271445    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271448    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271451    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271456    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271460    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271464    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271467    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271470    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.271467 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271473    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271477    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271480    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271482    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271485    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271487    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271490    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271494    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271497    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271499    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271502    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271505    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271507    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271510    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271512    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271515    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271517    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271520    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271522    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271525    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.271784 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271527    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271530    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271532    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271535    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271537    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271540    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271542    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271545    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271547    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271550    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271552    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271555    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271557    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271560    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271563    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271566    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271568    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271571    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271574    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271576    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.272316 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271580    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271583    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271585    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271588    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271591    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271593    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271596    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271598    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271601    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271605    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271608    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271611    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271614    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271617    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271619    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271622    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271624    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271627    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271630    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.272803 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271635    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271639    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271642    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271644    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271647    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271649    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271653    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271656    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271659    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271661    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271664    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271666    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271669    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271671    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271675    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271678    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271680    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271683    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271685    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271688    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.273281 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271691    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271693    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271696    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271698    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271701    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271703    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.271706    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272378    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272384    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272387    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272390    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272393    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272395    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272398    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272401    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272403    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272406    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272409    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272412    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272416    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.273774 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272419    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272421    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272424    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272427    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272429    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272432    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272435    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272438    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272440    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272443    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272446    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272448    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272451    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272453    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272456    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272459    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272461    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272464    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272466    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272469    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.274308 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272471    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272474    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272476    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272479    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272481    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272484    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272486    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272489    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272491    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272494    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272497    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272500    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272503    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272505    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272508    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272511    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272513    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272516    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272521    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.274808 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272525    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272528    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272531    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272534    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272537    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272539    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272542    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272544    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272547    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272550    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272553    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272555    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272558    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272561    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272564    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272567    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272569    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272572    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272575    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.275317 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272577    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272580    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272582    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272585    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272587    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272590    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272592    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272595    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272597    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272600    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272603    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272605    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272607    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272610    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272612    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272616    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272620    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272623    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272626    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272628    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.275798 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272631    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272634    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272636    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272639    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272641    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272644    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272646    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.272649    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273688    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273695    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273699    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273702    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273705    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273708    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273710    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273713    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273715    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273718    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273721    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273723    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.276303 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273726    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273728    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273731    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273734    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273737    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273739    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273742    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273745    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273747    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273750    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273752    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273755    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273758    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273762    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273765    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273768    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273771    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273774    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273779    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273783    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.276776 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273786    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273789    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273792    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273795    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273798    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273800    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273803    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273805    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273808    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273810    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273813    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273815    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273818    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273820    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273823    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273825    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273828    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273830    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273833    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.277277 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273835    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273838    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273841    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273846    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273849    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273852    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273854    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273857    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273859    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273875    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273877    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273881    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273884    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273887    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273890    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273892    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273895    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273898    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273900    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.277740 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273903    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273905    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273908    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273910    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273913    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273915    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273918    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273920    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273923    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273925    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273928    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273931    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273935    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273937    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273940    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273943    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273945    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273948    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273950    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273953    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.278223 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273956    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273960    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273963    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273965    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273969    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273972    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273974    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273977    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.273979    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274047    2571 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274079    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274084    2571 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274091    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274095    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274098    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274102    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274106    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274109    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274112    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274116    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274119    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274122    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 12:47:37.278706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274125    2571 flags.go:64] FLAG: --cgroup-root=""
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274128    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274131    2571 flags.go:64] FLAG: --client-ca-file=""
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274133    2571 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274136    2571 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274142    2571 flags.go:64] FLAG: --cluster-domain=""
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274145    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274148    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274151    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274155    2571 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274159    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274162    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274165    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274168    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274173    2571 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274176    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274179    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274182    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274185    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274189    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274192    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274194    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274197    2571 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274200    2571 flags.go:64] FLAG: --enable-server="true"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274203    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 12:47:37.279255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274207    2571 flags.go:64] FLAG: --event-burst="100"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274209    2571 flags.go:64] FLAG: --event-qps="50"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274218    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274223    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274226    2571 flags.go:64] FLAG: --eviction-hard=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274230    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274233    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274236    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274240    2571 flags.go:64] FLAG: --eviction-soft=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274242    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274245    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274248    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274253    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274256    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274259    2571 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274262    2571 flags.go:64] FLAG: --feature-gates=""
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274266    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274269    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274272    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274275    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274278    2571 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274283    2571 flags.go:64] FLAG: --help="false"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274285    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274289    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 12:47:37.279908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274292    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274295    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274298    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274301    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274304    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274307    2571 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274310    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274313    2571 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274316    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274319    2571 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274322    2571 flags.go:64] FLAG: --kube-reserved=""
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274325    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274328    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274331    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274334    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274336    2571 flags.go:64] FLAG: --lock-file=""
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274339    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274342    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274345    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274350    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274354    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274357    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274360    2571 flags.go:64] FLAG: --logging-format="text"
Sep 16 12:47:37.280547 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274363    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274366    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274369    2571 flags.go:64] FLAG: --manifest-url=""
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274372    2571 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274376    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274379    2571 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274383    2571 flags.go:64] FLAG: --max-pods="110"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274386    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274389    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274392    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274395    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274398    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274401    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274404    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274411    2571 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274413    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274416    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274420    2571 flags.go:64] FLAG: --pod-cidr=""
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274423    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274428    2571 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274431    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274434    2571 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274437    2571 flags.go:64] FLAG: --port="10250"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274440    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 12:47:37.281117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274443    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025ca59ad295429b7"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274446    2571 flags.go:64] FLAG: --qos-reserved=""
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274448    2571 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274451    2571 flags.go:64] FLAG: --register-node="true"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274454    2571 flags.go:64] FLAG: --register-with-taints=""
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274459    2571 flags.go:64] FLAG: --registry-burst="10"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274462    2571 flags.go:64] FLAG: --registry-qps="5"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274464    2571 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274467    2571 flags.go:64] FLAG: --reserved-memory=""
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274471    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274474    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274477    2571 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274480    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274483    2571 flags.go:64] FLAG: --runonce="false"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274486    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274490    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274493    2571 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274500    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274503    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274506    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274509    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274512    2571 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274515    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274518    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274521    2571 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274524    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 12:47:37.281707 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274527    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274530    2571 flags.go:64] FLAG: --system-cgroups=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274533    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274538    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274541    2571 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274544    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274547    2571 flags.go:64] FLAG: --tls-min-version=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274551    2571 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274554    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274557    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274560    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274564    2571 flags.go:64] FLAG: --v="2"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274568    2571 flags.go:64] FLAG: --version="false"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274578    2571 flags.go:64] FLAG: --vmodule=""
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274586    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.274589    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274695    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274699    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274702    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274704    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274707    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274711    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274714    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.282736 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274717    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274720    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274722    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274725    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274729    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274733    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274736    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274739    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274742    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274745    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274748    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274750    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274753    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274756    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274759    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274761    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274764    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274767    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274771    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.283494 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274774    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274779    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274783    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274785    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274789    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274792    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274796    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274799    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274802    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274805    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274808    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274812    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274815    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274818    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274821    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274824    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274826    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274829    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274832    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.283983 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274835    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274837    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274840    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274843    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274845    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274848    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274850    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274853    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274856    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274858    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274877    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274880    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274882    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274885    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274889    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274892    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274895    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274897    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274900    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274903    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.284438 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274906    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274909    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274912    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274914    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274918    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274920    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274923    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274925    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274928    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274931    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274934    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274936    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274939    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274942    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274945    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274947    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274950    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274952    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274955    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274957    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.284973 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274960    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274962    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274965    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274968    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274971    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274973    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274978    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274981    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274983    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274986    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274989    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274991    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274994    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.274996    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.275743    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:47:37.285455 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.284404    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.284417    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.285286    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.285297    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285358    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285363    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285366    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285369    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285372    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285375    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285378    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285382    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285386    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285389    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285392    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285395    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285398    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285401    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285403    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.285834 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285406    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285409    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285411    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285414    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285417    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285420    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285422    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285425    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285428    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285430    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285433    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285436    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285438    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285447    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285450    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285452    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285455    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285458    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285461    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285464    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.286319 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285467    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285469    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285472    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285474    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285478    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285482    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285485    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285488    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285491    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285494    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285497    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285500    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285503    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285505    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285508    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285511    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285513    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285516    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285518    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285521    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.286819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285523    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285526    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285528    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285531    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285533    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285536    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285538    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285541    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285544    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285546    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285549    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285551    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285554    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285556    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285559    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285561    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285564    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285566    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285569    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.287324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285572    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285575    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285578    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285580    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285583    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285586    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285588    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285591    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285594    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285596    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285599    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285601    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285604    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285606    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285609    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285611    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285614    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285616    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285620    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285623    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.287788 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285627    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285630    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285633    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285636    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285639    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.285644    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285771    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285776    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285779    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285782    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285785    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285787    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285790    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285793    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285795    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:47:37.288350 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285798    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285800    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285803    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285806    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285809    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285812    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285815    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285817    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285819    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285822    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285824    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285827    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285829    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285832    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285835    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285838    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285840    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285843    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285846    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285849    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:47:37.288711 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285852    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285854    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285857    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285859    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285872    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285875    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285878    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285880    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285883    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285886    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285888    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285891    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285893    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285896    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285898    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285901    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285904    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285906    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285909    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285912    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:47:37.289218 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285914    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285917    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285920    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285922    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285924    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285927    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285930    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285932    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285935    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285937    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285940    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285943    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285945    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285948    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285951    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285953    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285957    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285961    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285964    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285967    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:47:37.289689 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285969    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285972    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285975    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285978    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285980    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285983    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285985    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285988    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285990    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285993    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.285997    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286001    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286004    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286007    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286010    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286012    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286015    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286018    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286021    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286024    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:47:37.290204 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286027    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286030    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286032    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286035    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286038    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286042    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286045    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286048    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286051    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:37.286054    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.286058    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.286180    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.289610    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 12:47:37.290719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.290673    2571 server.go:1019] "Starting client certificate rotation"
Sep 16 12:47:37.291165 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.290794    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:47:37.291165 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.290837    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:47:37.293496 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.293480    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:47:37.298254 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.298236    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:47:37.310684 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.310663    2571 log.go:25] "Validated CRI v1 runtime API"
Sep 16 12:47:37.314087 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.314073    2571 log.go:25] "Validated CRI v1 image API"
Sep 16 12:47:37.314884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.314855    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 12:47:37.317493 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.317473    2571 fs.go:135] Filesystem UUIDs: map[247e068d-a82b-42ac-bf9f-c460cdce81b6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ac7187e0-4006-4254-abc5-30f692d25672:/dev/nvme0n1p3]
Sep 16 12:47:37.317555 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.317501    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 12:47:37.323916 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.323796    2571 manager.go:216] Machine: {Timestamp:2026-09-16 12:47:37.323340103 +0000 UTC m=+0.378557603 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098941 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f22049f52f95daad33ff71a6615b SystemUUID:ec28f220-49f5-2f95-daad-33ff71a6615b BootID:6a483028-841e-42e3-9c7d-eb1792c95d30 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:da:11:95:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:da:11:95:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:8e:2a:b3:31:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 12:47:37.323916 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.323905    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 12:47:37.324074 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.323979    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 12:47:37.324349 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.324331    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:47:37.326730 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.326707    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 12:47:37.326853 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.326734    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 12:47:37.327594 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.327584    2571 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 12:47:37.327624 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.327597    2571 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 12:47:37.327624 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.327605    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:47:37.328412 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.328401    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:47:37.329620 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.329610    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 12:47:37.333933 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.333922    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:47:37.334041 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334031    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 12:47:37.334075 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334060    2571 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 12:47:37.334075 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334069    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 12:47:37.334129 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334081    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 12:47:37.334129 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334089    2571 kubelet.go:398] "Adding apiserver pod source"
Sep 16 12:47:37.334129 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334113    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 12:47:37.334491 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334480    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:47:37.334520 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.334500    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:47:37.336827 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.336810    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 12:47:37.339878 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.339855    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 12:47:37.339950 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.339895    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 12:47:37.341938 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341918    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341945    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341955    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341962    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341973    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.341981    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342003    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342011    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342018    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 12:47:37.342028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342023    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 12:47:37.342266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342039    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 12:47:37.342266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342044    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 12:47:37.343006 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.342992    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 12:47:37.343006 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.343003    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 12:47:37.344068 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.344034    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 12:47:37.344068 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.344036    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 12:47:37.346650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.346635    2571 server.go:1268] "Started kubelet"
Sep 16 12:47:37.346851 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.346801    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 12:47:37.346929 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.346888    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 12:47:37.347431 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.347396    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 12:47:37.347481 ip-10-0-131-158 systemd[1]: Started Kubernetes Kubelet.
Sep 16 12:47:37.348284 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.348268    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 12:47:37.349433 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.349416    2571 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 12:47:37.353675 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.353614    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 12:47:37.356631 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.356614    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 12:47:37.357058 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.357031    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 12:47:37.357279 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.357265    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 12:47:37.357447 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.357385    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.360308 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.360128    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 12:47:37.360411 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.360400    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 12:47:37.360509 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.357053    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-158.ec2.internal.18d5cdefef60a5b3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-158.ec2.internal,UID:ip-10-0-131-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-158.ec2.internal,},FirstTimestamp:2026-09-16 12:47:37.346606515 +0000 UTC m=+0.401824014,LastTimestamp:2026-09-16 12:47:37.346606515 +0000 UTC m=+0.401824014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-158.ec2.internal,}"
Sep 16 12:47:37.360676 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.360658    2571 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 12:47:37.360731 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.360674    2571 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 12:47:37.360797 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.360778    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 12:47:37.361961 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.361940    2571 factory.go:55] Registering systemd factory
Sep 16 12:47:37.361961 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.361964    2571 factory.go:223] Registration of the systemd container factory successfully
Sep 16 12:47:37.362234 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.362218    2571 factory.go:153] Registering CRI-O factory
Sep 16 12:47:37.362234 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.362235    2571 factory.go:223] Registration of the crio container factory successfully
Sep 16 12:47:37.362370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.362292    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 12:47:37.362370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.362310    2571 factory.go:103] Registering Raw factory
Sep 16 12:47:37.362370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.362325    2571 manager.go:1196] Started watching for new ooms in manager
Sep 16 12:47:37.363428 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.363412    2571 manager.go:349] Starting recovery of all containers
Sep 16 12:47:37.371088 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.371053    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpk66"
Sep 16 12:47:37.372261 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.372230    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 12:47:37.372423 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.372401    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 12:47:37.374883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.374849    2571 manager.go:354] Recovery completed
Sep 16 12:47:37.379118 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.379102    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpk66"
Sep 16 12:47:37.379805 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.379792    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.382084 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382065    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.382186 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382094    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.382186 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382104    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.382730 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382711    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 12:47:37.382730 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382728    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 12:47:37.382885 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382744    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:47:37.382885 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.382758    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.383525 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.383509    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.383578 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.383537    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.383578 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.383551    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.385059 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.385046    2571 policy_none.go:49] "None policy: Start"
Sep 16 12:47:37.385059 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.385061    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 12:47:37.385146 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.385076    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 12:47:37.387028 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.387017    2571 policy_none.go:47] "Start"
Sep 16 12:47:37.412405 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412386    2571 manager.go:337] "Starting Device Plugin manager"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.412427    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412436    2571 server.go:87] "Starting device plugin registration server"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412724    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412739    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412807    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412921    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.412930    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.414804    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.414887    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.425259    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.426526    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.426567    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.426585    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.426620    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 12:47:37.438363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.428112    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:37.513565 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.513547    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.514796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.514778    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.514898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.514810    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.514898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.514822    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.514898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.514847    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.524120 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.524076    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.524120 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.524094    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-158.ec2.internal\": node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.526925 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.526901    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"]
Sep 16 12:47:37.527021 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.526969    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.531814 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.531799    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.531902 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.531824    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.531902 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.531834    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.534130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534118    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.534260 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.534314 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534280    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.534777 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534762    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.534777 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534767    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.534913 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534788    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.534913 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534792    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.534913 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534803    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.534913 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.534803    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.537119 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.537106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.537170 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.537130    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:47:37.537768 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.537753    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:47:37.537831 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.537777    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:47:37.537831 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.537787    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:47:37.563221 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.563205    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.573456 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.573434    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-158.ec2.internal\" not found" node="ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.577588 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.577574    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-158.ec2.internal\" not found" node="ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.662746 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.662726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.662836 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.662753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.662836 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.662767    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ed2df6b6d0932adc64ea3a34b652a6a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"3ed2df6b6d0932adc64ea3a34b652a6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.663760 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.663745    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.763266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.763341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763278    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.763341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763290    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.763341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ed2df6b6d0932adc64ea3a34b652a6a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"3ed2df6b6d0932adc64ea3a34b652a6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.763341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ed2df6b6d0932adc64ea3a34b652a6a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-158.ec2.internal\" (UID: \"3ed2df6b6d0932adc64ea3a34b652a6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.763474 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.763350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e090d741acefb369b00f3375e5501e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal\" (UID: \"79e090d741acefb369b00f3375e5501e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.764295 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.764279    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.865107 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.865055    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:37.877220 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.877205    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.881352 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:37.881338    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:37.966074 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:37.966049    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:38.066590 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.066553    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:38.167175 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.167112    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-158.ec2.internal\" not found"
Sep 16 12:47:38.188581 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.188563    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:38.252836 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.252814    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:38.257987 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.257969    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:38.270874 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.270852    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:47:38.272073 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.272059    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal"
Sep 16 12:47:38.280439 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.280411    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:47:38.291374 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.291355    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 12:47:38.291478 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.291460    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:47:38.291523 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.291497    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:47:38.291523 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.291497    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:47:38.337048 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.337027    2571 apiserver.go:52] "Watching apiserver"
Sep 16 12:47:38.356142 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.356112    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 12:47:38.357021 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.357004    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 12:47:38.357429 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.357407    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wbfkt","openshift-image-registry/node-ca-59cfr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal","openshift-multus/multus-6r4fn","openshift-network-diagnostics/network-check-target-bcj6t","openshift-network-operator/iptables-alerter-h6lwj","kube-system/konnectivity-agent-gcgmg","kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd","openshift-cluster-node-tuning-operator/tuned-4sxjw","openshift-multus/multus-additional-cni-plugins-z9zbp","openshift-multus/network-metrics-daemon-hw5xf","openshift-ovn-kubernetes/ovnkube-node-rwjbf","kube-system/global-pull-secret-syncer-cf2n6"]
Sep 16 12:47:38.360171 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.360154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.362468 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.362443    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.362792 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.362768    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.362858 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.362844    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-djt86\""
Sep 16 12:47:38.363432 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.363404    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.365805 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.365777    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 12:47:38.365937 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.365846    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.366917 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.366897    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-44z7w\""
Sep 16 12:47:38.367025 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.366933    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.367025 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.366943    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.367122 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-sys\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367122 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-host\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.367122 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-modprobe-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367276 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-kubernetes\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367276 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-run\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367276 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-tmp\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367276 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367270    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-serviceca\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysconfig\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367346    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-conf\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-host\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367416    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gln27\" (UniqueName: \"kubernetes.io/projected/486d0c13-c93d-49d2-8ba1-74ad247308ed-kube-api-access-gln27\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367443 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-systemd\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-lib-modules\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-var-lib-kubelet\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-tuned\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.367650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.367578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mphdq\" (UniqueName: \"kubernetes.io/projected/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-kube-api-access-mphdq\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.368298 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.368283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.370580 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.370565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:38.370668 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.370643    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:38.371963 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.371924    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vvmw6\""
Sep 16 12:47:38.372076 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372062    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.372736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372713    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jh7wb\""
Sep 16 12:47:38.372842 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372761    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.372842 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372773    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 12:47:38.372842 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372787    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.372842 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372792    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.373053 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.372947    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.373053 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.373044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 12:47:38.373585 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.373569    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:47:38.375310 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.375296    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.377622 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.377603    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.378134 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.378114    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.378187 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.378149    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 12:47:38.379130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.379112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-94rvv\""
Sep 16 12:47:38.379209 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.379184    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 12:47:38.379275 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.379232    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.379339 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.379189    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bt87z\""
Sep 16 12:47:38.379339 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.379295    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 12:47:38.380018 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.380003    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.380148 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.380128    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zctbx\""
Sep 16 12:47:38.380235 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.380176    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 12:47:38.381037 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.381021    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.381641 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.381622    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.382376 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.382358    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.382461 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.382439    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:38.383039 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.383014    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 12:47:38.383039 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.383035    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 12:47:38.383187 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.383161    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j5k2j\""
Sep 16 12:47:38.384879 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.384793    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 12:42:37 +0000 UTC" deadline="2028-02-24 21:20:05.085758726 +0000 UTC"
Sep 16 12:47:38.384879 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.384874    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12632h32m26.700888552s"
Sep 16 12:47:38.385012 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.384865    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.387323 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.387303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.387385 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.387357    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:38.390130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.390111    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 12:47:38.390987 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.390961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 12:47:38.391079 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.391012    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 12:47:38.391079 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.391019    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 12:47:38.391186 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.391025    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 12:47:38.391186 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.391012    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 12:47:38.391680 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.391658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x4kjb\""
Sep 16 12:47:38.400287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.400265    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nfhsh"
Sep 16 12:47:38.407607 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.407592    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nfhsh"
Sep 16 12:47:38.462262 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.462244    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 12:47:38.467773 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-log-socket\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.467896 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.467896 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467840    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-sys\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.467896 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-host\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.468047 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012aa80-b2f4-43a7-b039-790ec85dd647-tmp-dir\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.468047 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-sys\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.468047 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-bin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.468047 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.467995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-etc-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.468047 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-host\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-env-overrides\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-modprobe-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7641836f-d23e-4e56-af2b-0b45ddcaf321-konnectivity-ca\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-socket-dir-parent\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-k8s-cni-cncf-io\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-daemon-config\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-modprobe-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-slash\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-var-lib-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xjjt\" (UniqueName: \"kubernetes.io/projected/10e50322-039a-4fa1-bb74-75f2d5d9beb1-kube-api-access-6xjjt\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gln27\" (UniqueName: \"kubernetes.io/projected/486d0c13-c93d-49d2-8ba1-74ad247308ed-kube-api-access-gln27\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.468392 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-var-lib-kubelet\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-tuned\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-var-lib-kubelet\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-d\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-script-lib\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468697    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-socket-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468761    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-kubelet\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-kubelet\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-kubernetes\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-run\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-tmp\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-sys-fs\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-run\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-conf-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-kubernetes\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468998    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 12:47:38.469094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.468998    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-iptables-alerter-script\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-system-cni-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-systemd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-bin\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469153    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-netns\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8h2\" (UniqueName: \"kubernetes.io/projected/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-kube-api-access-bf8h2\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-config\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7641836f-d23e-4e56-af2b-0b45ddcaf321-agent-certs\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-device-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-cni-binary-copy\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469407    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-systemd-units\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-netns\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.469883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-ovn\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-serviceca\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-node-log\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysconfig\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysconfig\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-host\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-registration-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-cnibin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/759b6e1c-4047-4845-ab55-db7f80e64d4c-kube-api-access-bgdd7\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-host\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-netd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovn-node-metrics-cert\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-systemd\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-systemd\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-lib-modules\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mphdq\" (UniqueName: \"kubernetes.io/projected/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-kube-api-access-mphdq\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-lib-modules\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.470654 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.469983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpfr\" (UniqueName: \"kubernetes.io/projected/2012aa80-b2f4-43a7-b039-790ec85dd647-kube-api-access-8dpfr\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470025    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-dbus\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-serviceca\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rm5m\" (UniqueName: \"kubernetes.io/projected/560704e3-69c7-4f25-b83f-a95ac5daaf20-kube-api-access-7rm5m\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-host-slash\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwm5g\" (UniqueName: \"kubernetes.io/projected/9ef46b04-b6fb-441e-894f-526c5c20660e-kube-api-access-zwm5g\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-hostroot\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-kubelet-config\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-system-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-cnibin\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.471421 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-conf\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2012aa80-b2f4-43a7-b039-790ec85dd647-hosts-file\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-multus\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-etc-kubernetes\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-multus-certs\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470641    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-sysctl-conf\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.472111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.470698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29rt\" (UniqueName: \"kubernetes.io/projected/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-kube-api-access-k29rt\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.472923 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.472903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-etc-tuned\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.473017 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.472955    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486d0c13-c93d-49d2-8ba1-74ad247308ed-tmp\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.477883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.477865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gln27\" (UniqueName: \"kubernetes.io/projected/486d0c13-c93d-49d2-8ba1-74ad247308ed-kube-api-access-gln27\") pod \"tuned-4sxjw\" (UID: \"486d0c13-c93d-49d2-8ba1-74ad247308ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.481292 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.481179    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mphdq\" (UniqueName: \"kubernetes.io/projected/559aa60c-8f8d-44a2-a7f9-e46d0dcb1219-kube-api-access-mphdq\") pod \"node-ca-59cfr\" (UID: \"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219\") " pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.572023 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.571994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7641836f-d23e-4e56-af2b-0b45ddcaf321-agent-certs\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.572023 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-device-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-cni-binary-copy\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-systemd-units\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572093    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-netns\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572126    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-device-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572141    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-netns\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-systemd-units\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-ovn\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-node-log\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-ovn\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-node-log\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-registration-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-cnibin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-registration-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.572287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/759b6e1c-4047-4845-ab55-db7f80e64d4c-kube-api-access-bgdd7\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-cnibin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-netd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovn-node-metrics-cert\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpfr\" (UniqueName: \"kubernetes.io/projected/2012aa80-b2f4-43a7-b039-790ec85dd647-kube-api-access-8dpfr\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-netd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572431    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-dbus\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rm5m\" (UniqueName: \"kubernetes.io/projected/560704e3-69c7-4f25-b83f-a95ac5daaf20-kube-api-access-7rm5m\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-host-slash\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwm5g\" (UniqueName: \"kubernetes.io/projected/9ef46b04-b6fb-441e-894f-526c5c20660e-kube-api-access-zwm5g\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-host-slash\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-hostroot\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572638    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572651    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-cni-binary-copy\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-kubelet-config\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.573144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-system-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-hostroot\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-dbus\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-kubelet-config\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-cnibin\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572803    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-system-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-cni-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-cnibin\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.572963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2012aa80-b2f4-43a7-b039-790ec85dd647-hosts-file\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573019    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-multus\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574044 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573046    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2012aa80-b2f4-43a7-b039-790ec85dd647-hosts-file\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-etc-kubernetes\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-multus\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.573122    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-multus-certs\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-etc-kubernetes\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k29rt\" (UniqueName: \"kubernetes.io/projected/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-kube-api-access-k29rt\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.573187    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:47:39.073165931 +0000 UTC m=+2.128383446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573190    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-multus-certs\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-log-socket\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573242    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012aa80-b2f4-43a7-b039-790ec85dd647-tmp-dir\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-bin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-etc-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-env-overrides\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7641836f-d23e-4e56-af2b-0b45ddcaf321-konnectivity-ca\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.574884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-socket-dir-parent\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-k8s-cni-cncf-io\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-etc-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-daemon-config\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573485    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-log-socket\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-slash\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-cni-binary-copy\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-cni-bin\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-var-lib-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-socket-dir-parent\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xjjt\" (UniqueName: \"kubernetes.io/projected/10e50322-039a-4fa1-bb74-75f2d5d9beb1-kube-api-access-6xjjt\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573583    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-k8s-cni-cncf-io\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573608    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-script-lib\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-var-lib-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-socket-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-kubelet\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.575613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-slash\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-var-lib-kubelet\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-kubelet\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-sys-fs\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-conf-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-kubelet\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.573838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-iptables-alerter-script\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-daemon-config\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7641836f-d23e-4e56-af2b-0b45ddcaf321-konnectivity-ca\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574259    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-socket-dir\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574312    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ef46b04-b6fb-441e-894f-526c5c20660e-sys-fs\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-multus-conf-dir\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-system-cni-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-systemd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-bin\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574486    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-script-lib\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574492    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-iptables-alerter-script\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759b6e1c-4047-4845-ab55-db7f80e64d4c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-systemd\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759b6e1c-4047-4845-ab55-db7f80e64d4c-system-cni-dir\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574568    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-run-openvswitch\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-netns\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/560704e3-69c7-4f25-b83f-a95ac5daaf20-host-run-netns\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574603    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10e50322-039a-4fa1-bb74-75f2d5d9beb1-host-cni-bin\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8h2\" (UniqueName: \"kubernetes.io/projected/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-kube-api-access-bf8h2\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-config\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012aa80-b2f4-43a7-b039-790ec85dd647-tmp-dir\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.574774    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.574835    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:47:39.074818319 +0000 UTC m=+2.130035828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.574849    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-env-overrides\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.576681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.575138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7641836f-d23e-4e56-af2b-0b45ddcaf321-agent-certs\") pod \"konnectivity-agent-gcgmg\" (UID: \"7641836f-d23e-4e56-af2b-0b45ddcaf321\") " pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.577283 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.575245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovnkube-config\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.577283 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.575327    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e50322-039a-4fa1-bb74-75f2d5d9beb1-ovn-node-metrics-cert\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.585459 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.585427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rm5m\" (UniqueName: \"kubernetes.io/projected/560704e3-69c7-4f25-b83f-a95ac5daaf20-kube-api-access-7rm5m\") pod \"multus-6r4fn\" (UID: \"560704e3-69c7-4f25-b83f-a95ac5daaf20\") " pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.585716 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.585697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpfr\" (UniqueName: \"kubernetes.io/projected/2012aa80-b2f4-43a7-b039-790ec85dd647-kube-api-access-8dpfr\") pod \"node-resolver-wbfkt\" (UID: \"2012aa80-b2f4-43a7-b039-790ec85dd647\") " pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.585841 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.585821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29rt\" (UniqueName: \"kubernetes.io/projected/b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e-kube-api-access-k29rt\") pod \"iptables-alerter-h6lwj\" (UID: \"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e\") " pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.586156 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.586135    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:38.586156 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.586159    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:38.586357 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.586172    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:38.586357 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:38.586239    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:39.086223595 +0000 UTC m=+2.141441101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:38.586357 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.586261    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwm5g\" (UniqueName: \"kubernetes.io/projected/9ef46b04-b6fb-441e-894f-526c5c20660e-kube-api-access-zwm5g\") pod \"aws-ebs-csi-driver-node-ph9gd\" (UID: \"9ef46b04-b6fb-441e-894f-526c5c20660e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.586357 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.586297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/759b6e1c-4047-4845-ab55-db7f80e64d4c-kube-api-access-bgdd7\") pod \"multus-additional-cni-plugins-z9zbp\" (UID: \"759b6e1c-4047-4845-ab55-db7f80e64d4c\") " pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.588331 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.588208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xjjt\" (UniqueName: \"kubernetes.io/projected/10e50322-039a-4fa1-bb74-75f2d5d9beb1-kube-api-access-6xjjt\") pod \"ovnkube-node-rwjbf\" (UID: \"10e50322-039a-4fa1-bb74-75f2d5d9beb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.589001 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.588552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8h2\" (UniqueName: \"kubernetes.io/projected/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-kube-api-access-bf8h2\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:38.620903 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.620857    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e090d741acefb369b00f3375e5501e.slice/crio-5466c57c2931a700c68ad71842b8c38b290bf732212f6437f004d1674f54443b WatchSource:0}: Error finding container 5466c57c2931a700c68ad71842b8c38b290bf732212f6437f004d1674f54443b: Status 404 returned error can't find the container with id 5466c57c2931a700c68ad71842b8c38b290bf732212f6437f004d1674f54443b
Sep 16 12:47:38.625451 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.625437    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:47:38.683045 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.682993    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:38.686400 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.686387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sxjw"
Sep 16 12:47:38.695707 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.695687    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486d0c13_c93d_49d2_8ba1_74ad247308ed.slice/crio-4dd6977e3ed53623a63718fbb8f4331af735b3391f2fbe908914df0f14d42d54 WatchSource:0}: Error finding container 4dd6977e3ed53623a63718fbb8f4331af735b3391f2fbe908914df0f14d42d54: Status 404 returned error can't find the container with id 4dd6977e3ed53623a63718fbb8f4331af735b3391f2fbe908914df0f14d42d54
Sep 16 12:47:38.703733 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.703713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59cfr"
Sep 16 12:47:38.713011 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.712993    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559aa60c_8f8d_44a2_a7f9_e46d0dcb1219.slice/crio-075325d201fc19058c566928ce3421cc6336ae45e28b353f4491b479706ec172 WatchSource:0}: Error finding container 075325d201fc19058c566928ce3421cc6336ae45e28b353f4491b479706ec172: Status 404 returned error can't find the container with id 075325d201fc19058c566928ce3421cc6336ae45e28b353f4491b479706ec172
Sep 16 12:47:38.722090 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.722073    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6r4fn"
Sep 16 12:47:38.729027 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.729003    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbfkt"
Sep 16 12:47:38.729845 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.729829    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560704e3_69c7_4f25_b83f_a95ac5daaf20.slice/crio-42d21be071bc143bb5cece537819d96078ed118b424c7bf48d3bc401d19193eb WatchSource:0}: Error finding container 42d21be071bc143bb5cece537819d96078ed118b424c7bf48d3bc401d19193eb: Status 404 returned error can't find the container with id 42d21be071bc143bb5cece537819d96078ed118b424c7bf48d3bc401d19193eb
Sep 16 12:47:38.737324 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.737302    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2012aa80_b2f4_43a7_b039_790ec85dd647.slice/crio-d6a6e823e43f08e9d29942d4f9e5d4b36458f7ca70b42e906894723b493ef2ab WatchSource:0}: Error finding container d6a6e823e43f08e9d29942d4f9e5d4b36458f7ca70b42e906894723b493ef2ab: Status 404 returned error can't find the container with id d6a6e823e43f08e9d29942d4f9e5d4b36458f7ca70b42e906894723b493ef2ab
Sep 16 12:47:38.741511 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.741489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6lwj"
Sep 16 12:47:38.750228 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.750198    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2436c9c_8df6_4a32_8122_5e3e9a7c3e0e.slice/crio-0cfbe51968602ebc1d772add561260cc7a8006f07e161f82559d60cc1350248f WatchSource:0}: Error finding container 0cfbe51968602ebc1d772add561260cc7a8006f07e161f82559d60cc1350248f: Status 404 returned error can't find the container with id 0cfbe51968602ebc1d772add561260cc7a8006f07e161f82559d60cc1350248f
Sep 16 12:47:38.764682 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.764655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:47:38.771643 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.771623    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd"
Sep 16 12:47:38.772347 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.772328    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7641836f_d23e_4e56_af2b_0b45ddcaf321.slice/crio-716466c5ecb4b8d459c8fbcf5f303bb26edfeffaf9c80a4ccca37b99ec103ba1 WatchSource:0}: Error finding container 716466c5ecb4b8d459c8fbcf5f303bb26edfeffaf9c80a4ccca37b99ec103ba1: Status 404 returned error can't find the container with id 716466c5ecb4b8d459c8fbcf5f303bb26edfeffaf9c80a4ccca37b99ec103ba1
Sep 16 12:47:38.779511 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.779494    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef46b04_b6fb_441e_894f_526c5c20660e.slice/crio-f70a00883f6dd1830991b826b1bcd2f171e40ea8cc053830b93250f536416fa8 WatchSource:0}: Error finding container f70a00883f6dd1830991b826b1bcd2f171e40ea8cc053830b93250f536416fa8: Status 404 returned error can't find the container with id f70a00883f6dd1830991b826b1bcd2f171e40ea8cc053830b93250f536416fa8
Sep 16 12:47:38.802795 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.802773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z9zbp"
Sep 16 12:47:38.807552 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:38.807532    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:47:38.817905 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.817886    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759b6e1c_4047_4845_ab55_db7f80e64d4c.slice/crio-bec04c25b57feac8ce3cd488d705e761417e5bb197ad4c7d2e95f672008bd822 WatchSource:0}: Error finding container bec04c25b57feac8ce3cd488d705e761417e5bb197ad4c7d2e95f672008bd822: Status 404 returned error can't find the container with id bec04c25b57feac8ce3cd488d705e761417e5bb197ad4c7d2e95f672008bd822
Sep 16 12:47:38.827360 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.827343    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e50322_039a_4fa1_bb74_75f2d5d9beb1.slice/crio-741a8d9f28d98c79baa79017ef290648aa6d893f7b49818f1a1d160bccf8e336 WatchSource:0}: Error finding container 741a8d9f28d98c79baa79017ef290648aa6d893f7b49818f1a1d160bccf8e336: Status 404 returned error can't find the container with id 741a8d9f28d98c79baa79017ef290648aa6d893f7b49818f1a1d160bccf8e336
Sep 16 12:47:38.830361 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:47:38.830327    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed2df6b6d0932adc64ea3a34b652a6a.slice/crio-7af7124eda4a03338348c396ce552b88673e8cca558f0c6f808048e3ef0f125f WatchSource:0}: Error finding container 7af7124eda4a03338348c396ce552b88673e8cca558f0c6f808048e3ef0f125f: Status 404 returned error can't find the container with id 7af7124eda4a03338348c396ce552b88673e8cca558f0c6f808048e3ef0f125f
Sep 16 12:47:39.078206 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.078132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:39.078206 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.078179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:39.078372 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.078273    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:39.078372 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.078282    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:39.078372 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.078321    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:47:40.078308027 +0000 UTC m=+3.133525514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:39.078372 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.078345    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:47:40.078326889 +0000 UTC m=+3.133544378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:39.178703 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.178677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:39.178866 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.178807    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:39.178866 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.178828    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:39.178866 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.178842    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:39.179054 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:39.178913    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:40.178887143 +0000 UTC m=+3.234104639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:39.354441 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.354368    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:39.410640 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.410580    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:42:38 +0000 UTC" deadline="2028-05-02 18:25:28.080934395 +0000 UTC"
Sep 16 12:47:39.410640 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.410637    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14261h37m48.670301529s"
Sep 16 12:47:39.440514 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.440184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6lwj" event={"ID":"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e","Type":"ContainerStarted","Data":"0cfbe51968602ebc1d772add561260cc7a8006f07e161f82559d60cc1350248f"}
Sep 16 12:47:39.446520 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.446486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sxjw" event={"ID":"486d0c13-c93d-49d2-8ba1-74ad247308ed","Type":"ContainerStarted","Data":"4dd6977e3ed53623a63718fbb8f4331af735b3391f2fbe908914df0f14d42d54"}
Sep 16 12:47:39.455031 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.454948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"79e090d741acefb369b00f3375e5501e","Type":"ContainerStarted","Data":"5466c57c2931a700c68ad71842b8c38b290bf732212f6437f004d1674f54443b"}
Sep 16 12:47:39.458681 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.458653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"741a8d9f28d98c79baa79017ef290648aa6d893f7b49818f1a1d160bccf8e336"}
Sep 16 12:47:39.461198 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.461107    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerStarted","Data":"bec04c25b57feac8ce3cd488d705e761417e5bb197ad4c7d2e95f672008bd822"}
Sep 16 12:47:39.464989 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.464964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd" event={"ID":"9ef46b04-b6fb-441e-894f-526c5c20660e","Type":"ContainerStarted","Data":"f70a00883f6dd1830991b826b1bcd2f171e40ea8cc053830b93250f536416fa8"}
Sep 16 12:47:39.477958 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.477754    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcgmg" event={"ID":"7641836f-d23e-4e56-af2b-0b45ddcaf321","Type":"ContainerStarted","Data":"716466c5ecb4b8d459c8fbcf5f303bb26edfeffaf9c80a4ccca37b99ec103ba1"}
Sep 16 12:47:39.479759 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.479722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbfkt" event={"ID":"2012aa80-b2f4-43a7-b039-790ec85dd647","Type":"ContainerStarted","Data":"d6a6e823e43f08e9d29942d4f9e5d4b36458f7ca70b42e906894723b493ef2ab"}
Sep 16 12:47:39.483170 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.483111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6r4fn" event={"ID":"560704e3-69c7-4f25-b83f-a95ac5daaf20","Type":"ContainerStarted","Data":"42d21be071bc143bb5cece537819d96078ed118b424c7bf48d3bc401d19193eb"}
Sep 16 12:47:39.494128 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.494065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59cfr" event={"ID":"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219","Type":"ContainerStarted","Data":"075325d201fc19058c566928ce3421cc6336ae45e28b353f4491b479706ec172"}
Sep 16 12:47:39.496883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:39.496819    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" event={"ID":"3ed2df6b6d0932adc64ea3a34b652a6a","Type":"ContainerStarted","Data":"7af7124eda4a03338348c396ce552b88673e8cca558f0c6f808048e3ef0f125f"}
Sep 16 12:47:40.053402 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.053346    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:40.087426 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.087385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:40.087621 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.087467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:40.087621 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.087615    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:40.087739 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.087681    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:47:42.087662521 +0000 UTC m=+5.142880012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:40.088129 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.088109    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:40.088226 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.088166    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:47:42.088149957 +0000 UTC m=+5.143367448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:40.188530 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.188487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:40.188759 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.188739    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:40.188829 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.188768    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:40.188829 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.188781    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:40.188997 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.188839    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:42.188820215 +0000 UTC m=+5.244037725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:40.412008 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.411895    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:42:38 +0000 UTC" deadline="2028-04-16 11:56:08.291504677 +0000 UTC"
Sep 16 12:47:40.412008 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.411957    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13871h8m27.879551844s"
Sep 16 12:47:40.427496 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.427469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:40.427649 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.427611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:40.427791 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.427752    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:40.427791 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.427605    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:40.427922 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.427834    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:40.427992 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:40.427962    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:40.730774 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:40.730691    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.106627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.106700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.106851    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.106941    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:47:46.106900229 +0000 UTC m=+9.162117718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.107025    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:42.107477 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.107067    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:47:46.10705322 +0000 UTC m=+9.162270729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:42.207894 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.207268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:42.207894 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.207456    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:42.207894 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.207476    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:42.207894 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.207489    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:42.207894 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.207549    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:46.207531768 +0000 UTC m=+9.262749258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:42.427659 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.427627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:42.427859 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.427773    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:42.428066 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.428044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:42.428341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:42.428176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:42.428341 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.428290    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:42.428341 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:42.428175    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:44.427082 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:44.427020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:44.427569 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:44.427030    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:44.427569 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:44.427155    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:44.427569 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:44.427216    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:44.427569 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:44.427034    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:44.427569 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:44.427278    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:46.138538 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.138483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:46.139151 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.138639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:46.139151 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.138641    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:46.139151 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.138728    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:47:54.138709002 +0000 UTC m=+17.193926492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:46.139151 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.138768    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:46.139151 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.138829    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:47:54.138816105 +0000 UTC m=+17.194033608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:46.239287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.239200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:46.239434 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.239346    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:46.239434 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.239373    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:46.239434 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.239389    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:46.239607 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.239448    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:54.239433314 +0000 UTC m=+17.294650816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:46.427432 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.427397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:46.427645 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.427521    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:46.427645 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.427521    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:46.427645 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:46.427551    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:46.427844 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.427656    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:46.427844 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:46.427741    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:48.427806 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:48.427766    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:48.428239 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:48.427923    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:48.428239 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:48.428005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:48.428239 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:48.428121    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:48.428239 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:48.428168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:48.428423 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:48.428239    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:50.427671 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:50.427641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:50.427671 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:50.427670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:50.428089 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:50.427645    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:50.428089 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:50.427761    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:50.428089 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:50.427826    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:50.428089 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:50.427898    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:52.427818 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:52.427740    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:52.428204 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:52.427878    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:52.428204 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:52.427883    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:52.428204 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:52.427891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:52.428204 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:52.427994    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:52.428204 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:52.428083    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:54.193552 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.193517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:54.194025 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.193590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:54.194025 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.193687    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:54.194025 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.193688    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:54.194025 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.193764    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:48:10.193742728 +0000 UTC m=+33.248960237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:47:54.194025 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.193819    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:48:10.193797767 +0000 UTC m=+33.249015267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:47:54.294375 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.294347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:54.294547 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.294461    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:47:54.294547 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.294477    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:47:54.294547 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.294490    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:54.294547 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.294535    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:10.294523063 +0000 UTC m=+33.349740549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:47:54.427397 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.427359    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:54.427621 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.427477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:54.427621 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.427490    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:54.427621 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:54.427515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:54.427768 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.427623    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:54.427768 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:54.427718    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:56.427665 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:56.427630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:56.427665 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:56.427652    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:56.428310 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:56.427710    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:56.428310 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:56.427827    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:56.428310 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:56.427903    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:56.428310 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:56.427960    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:58.426946 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.426807    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:47:58.427300 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.426840    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:47:58.427300 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:58.427143    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:47:58.427300 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:58.427005    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:47:58.427300 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.426846    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:47:58.427300 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:47:58.427259    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:47:58.557929 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.557902    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" event={"ID":"3ed2df6b6d0932adc64ea3a34b652a6a","Type":"ContainerStarted","Data":"b3ff58462dee8f81214d472d566f90925f5ca12df58b0910bedc7c8acdfccc07"}
Sep 16 12:47:58.559268 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.559238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sxjw" event={"ID":"486d0c13-c93d-49d2-8ba1-74ad247308ed","Type":"ContainerStarted","Data":"a2904bb3e65f69324b2f1a3ad0eb9dac8c3d6dcf50e879bb55b18502df1ed938"}
Sep 16 12:47:58.560614 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.560595    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"9de2da0305acc0061bc4345e4458628cea7dc9b7793d58ed49302885fc7e03df"}
Sep 16 12:47:58.573625 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:58.573589    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-158.ec2.internal" podStartSLOduration=20.573576747 podStartE2EDuration="20.573576747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:58.573296515 +0000 UTC m=+21.628514024" watchObservedRunningTime="2026-09-16 12:47:58.573576747 +0000 UTC m=+21.628794255"
Sep 16 12:47:59.564323 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.564293    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59cfr" event={"ID":"559aa60c-8f8d-44a2-a7f9-e46d0dcb1219","Type":"ContainerStarted","Data":"7b879d76effba3984d73efd6258ca598435e2b6e029e2ba19e26e0146991cf67"}
Sep 16 12:47:59.565919 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.565892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6lwj" event={"ID":"b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e","Type":"ContainerStarted","Data":"572d3041aa1f1bd2fc739040f33e0f2224e28825addba0c7a32b0f30454fd9c6"}
Sep 16 12:47:59.567308 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.567285    2571 generic.go:356] "Generic (PLEG): container finished" podID="79e090d741acefb369b00f3375e5501e" containerID="faaece008fbb277562cc81bd0ad6a7fe55532d1891ffc723edae9f3b2d270eb8" exitCode=0
Sep 16 12:47:59.567404 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.567354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"79e090d741acefb369b00f3375e5501e","Type":"ContainerDied","Data":"faaece008fbb277562cc81bd0ad6a7fe55532d1891ffc723edae9f3b2d270eb8"}
Sep 16 12:47:59.570286 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570268    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:47:59.570605 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570586    2571 generic.go:356] "Generic (PLEG): container finished" podID="10e50322-039a-4fa1-bb74-75f2d5d9beb1" containerID="346f4f4865f45e4c6c2d8d663f8e9bd820d07fb3d8dccd7a0d3f37b864030f93" exitCode=1
Sep 16 12:47:59.570675 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"a69d55e23634bcdee6adedabb3613beb010b0c8e398585b53e88d7bd31a09a46"}
Sep 16 12:47:59.570717 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"fc513cf1b8b7b00ca74a4af30637593f105f54fe1d74164f86885ac161ea6cd7"}
Sep 16 12:47:59.570763 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"d5261f3d136cc4733da575b8225323cf7eaa6d4653711468889a9d5aef7f2522"}
Sep 16 12:47:59.570798 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570768    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"52754f32b2a191f496d1f027aec64d7c1862b89165261b52a0c556df207c3ad3"}
Sep 16 12:47:59.570832 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.570797    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerDied","Data":"346f4f4865f45e4c6c2d8d663f8e9bd820d07fb3d8dccd7a0d3f37b864030f93"}
Sep 16 12:47:59.572051 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.572034    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="6804742290fe57e63fd6c02e4eeb1ae023bb5d72b28a533184af91e64c29ff02" exitCode=0
Sep 16 12:47:59.572138 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.572093    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"6804742290fe57e63fd6c02e4eeb1ae023bb5d72b28a533184af91e64c29ff02"}
Sep 16 12:47:59.573580 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.573563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd" event={"ID":"9ef46b04-b6fb-441e-894f-526c5c20660e","Type":"ContainerStarted","Data":"228d450ecd54dd6bb1317e9a5dee178a0abc4c9ab68c6fe111f41b3513992113"}
Sep 16 12:47:59.574908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.574892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcgmg" event={"ID":"7641836f-d23e-4e56-af2b-0b45ddcaf321","Type":"ContainerStarted","Data":"d10f8042afa0e3ea9df9114b8fdcae51ac78e1232027258b9295a1d2396fbc10"}
Sep 16 12:47:59.576333 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.576315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbfkt" event={"ID":"2012aa80-b2f4-43a7-b039-790ec85dd647","Type":"ContainerStarted","Data":"bd8c11ad43c799a2499307a35a819cf262b024f0a8747e844a2193eed75dfa2d"}
Sep 16 12:47:59.578189 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.578171    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6r4fn" event={"ID":"560704e3-69c7-4f25-b83f-a95ac5daaf20","Type":"ContainerStarted","Data":"1783702ce12fa1c1b347ddfd59d4976c43fac3e778bda4cb210c36e9b21d606a"}
Sep 16 12:47:59.579174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.579143    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4sxjw" podStartSLOduration=3.029687954 podStartE2EDuration="22.579131949s" totalImagesPullingTime="19.549443995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:58.593203451 +0000 UTC m=+21.648420959" watchObservedRunningTime="2026-09-16 12:47:59.579131949 +0000 UTC m=+22.634349456"
Sep 16 12:47:59.592670 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.592635    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-59cfr" podStartSLOduration=3.07742795 podStartE2EDuration="22.592625119s" totalImagesPullingTime="19.515197169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:59.578983252 +0000 UTC m=+22.634200774" watchObservedRunningTime="2026-09-16 12:47:59.592625119 +0000 UTC m=+22.647842654"
Sep 16 12:47:59.592816 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.592798    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h6lwj" podStartSLOduration=2.097928047 podStartE2EDuration="21.592793263s" totalImagesPullingTime="19.494865216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:59.592370409 +0000 UTC m=+22.647587916" watchObservedRunningTime="2026-09-16 12:47:59.592793263 +0000 UTC m=+22.648010772"
Sep 16 12:47:59.607457 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.607414    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gcgmg" podStartSLOduration=6.053889152 podStartE2EDuration="21.607398958s" totalImagesPullingTime="15.553509806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:59.607146103 +0000 UTC m=+22.662363612" watchObservedRunningTime="2026-09-16 12:47:59.607398958 +0000 UTC m=+22.662616467"
Sep 16 12:47:59.659857 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:47:59.659816    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wbfkt" podStartSLOduration=2.16905358 podStartE2EDuration="21.659803807s" totalImagesPullingTime="19.490750227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:59.659464872 +0000 UTC m=+22.714682380" watchObservedRunningTime="2026-09-16 12:47:59.659803807 +0000 UTC m=+22.715021314"
Sep 16 12:48:00.418664 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.418498    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 12:48:00.424375 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.424282    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:48:00.418660505Z","UUID":"6757ecdb-3871-4b27-80d7-17a77ab6e451","Handler":null,"Name":"","Endpoint":""}
Sep 16 12:48:00.425781 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.425761    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 12:48:00.425895 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.425795    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 12:48:00.426892 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.426839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:00.426892 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.426858    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:00.427042 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.426849    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:00.427042 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:00.426984    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:00.427175 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:00.427055    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:00.427302 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:00.427162    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:00.582588 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.582485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd" event={"ID":"9ef46b04-b6fb-441e-894f-526c5c20660e","Type":"ContainerStarted","Data":"56905f2e27dfc550b466eb4bb61fdf7a4e7cfac79b896c8abe7bae855fc3fc61"}
Sep 16 12:48:00.584259 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.584233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" event={"ID":"79e090d741acefb369b00f3375e5501e","Type":"ContainerStarted","Data":"35ee20a55dca4ba60b74bb78831271081f889d0d9001909ffc982fe9c8f6d171"}
Sep 16 12:48:00.601188 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.601139    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-158.ec2.internal" podStartSLOduration=22.601123261 podStartE2EDuration="22.601123261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:00.600518353 +0000 UTC m=+23.655735861" watchObservedRunningTime="2026-09-16 12:48:00.601123261 +0000 UTC m=+23.656340770"
Sep 16 12:48:00.601313 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:00.601212    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6r4fn" podStartSLOduration=2.682166718 podStartE2EDuration="22.601207871s" totalImagesPullingTime="19.919041153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:59.679644715 +0000 UTC m=+22.734862223" watchObservedRunningTime="2026-09-16 12:48:00.601207871 +0000 UTC m=+23.656425379"
Sep 16 12:48:01.589793 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:01.589763    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:48:01.590376 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:01.590347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"75d5211d578d067fc906288915fb94d985f008db8c3da281db809fc86880a6fa"}
Sep 16 12:48:01.770507 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:01.770469    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:48:01.771080 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:01.771056    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:48:02.426812 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.426780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:02.426991 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.426780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:02.426991 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:02.426905    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:02.426991 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.426916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:02.427093 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:02.426993    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:02.427093 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:02.427049    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:02.595727 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.595692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd" event={"ID":"9ef46b04-b6fb-441e-894f-526c5c20660e","Type":"ContainerStarted","Data":"4df67a3ab02ad2211f453a25c53158083928623ecc5d619986f16ca3b114e554"}
Sep 16 12:48:02.596180 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.595767    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:48:02.596531 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.596510    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gcgmg"
Sep 16 12:48:02.615282 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:02.615237    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph9gd" podStartSLOduration=2.67569131 podStartE2EDuration="24.615218764s" totalImagesPullingTime="21.939527454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:02.615027165 +0000 UTC m=+25.670244674" watchObservedRunningTime="2026-09-16 12:48:02.615218764 +0000 UTC m=+25.670436275"
Sep 16 12:48:04.427270 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:04.427243    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:04.427701 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:04.427352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:04.427701 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:04.427357    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:04.427701 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:04.427471    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:04.427701 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:04.427519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:04.427701 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:04.427667    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:04.604039 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:04.604015    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:48:05.610187 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.610018    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:48:05.610701 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.610575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"b56a76b433e7cb79ca521162cfb253d414ccef4098b7e9b7591cea215b442957"}
Sep 16 12:48:05.610847 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.610827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:05.611004 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.610981    2571 scope.go:117] "RemoveContainer" containerID="346f4f4865f45e4c6c2d8d663f8e9bd820d07fb3d8dccd7a0d3f37b864030f93"
Sep 16 12:48:05.612517 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.612493    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="b21b740f9c59b2d493c01925eb1e8491481d49e640f1adc0be3d13b1d1eeb45f" exitCode=0
Sep 16 12:48:05.612712 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.612527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"b21b740f9c59b2d493c01925eb1e8491481d49e640f1adc0be3d13b1d1eeb45f"}
Sep 16 12:48:05.626293 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:05.626278    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:06.426828 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.426800    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:06.427073 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.426914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:06.427073 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.426924    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:06.427073 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.426939    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:06.427073 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.427007    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:06.427282 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.427093    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:06.450312 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.450290    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hw5xf"]
Sep 16 12:48:06.453376 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.453353    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cf2n6"]
Sep 16 12:48:06.466957 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.466934    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcj6t"]
Sep 16 12:48:06.617900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.617879    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" event={"ID":"10e50322-039a-4fa1-bb74-75f2d5d9beb1","Type":"ContainerStarted","Data":"420f3f67b711adc1f0420bcbba6a87e698282e5b9e1fb6e2d2e68df63f519ee6"}
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.618300    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.618375    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:06.618484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618457    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:06.618822 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.618657    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:06.618822 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:06.618654    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:06.634068 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.634045    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:06.653080 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:06.653037    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf" podStartSLOduration=9.210385164 podStartE2EDuration="28.653021402s" totalImagesPullingTime="19.442636238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:06.651425704 +0000 UTC m=+29.706643212" watchObservedRunningTime="2026-09-16 12:48:06.653021402 +0000 UTC m=+29.708238907"
Sep 16 12:48:07.622173 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:07.622118    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="edd9767d98ee01a052f82c9e227b4c2f47c42c6cc115aee622e085a46353250a" exitCode=0
Sep 16 12:48:07.622560 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:07.622205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"edd9767d98ee01a052f82c9e227b4c2f47c42c6cc115aee622e085a46353250a"}
Sep 16 12:48:08.427145 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:08.426951    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:08.427307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:08.426965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:08.427307 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:08.427234    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:08.427416 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:08.427018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:08.427416 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:08.427334    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:08.427515 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:08.427455    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:09.628680 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:09.628645    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="a62b959630d116f7fda1ed3294477f7d3aa83d8b64c01407b67321e7b724d87d" exitCode=0
Sep 16 12:48:09.629045 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:09.628703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"a62b959630d116f7fda1ed3294477f7d3aa83d8b64c01407b67321e7b724d87d"}
Sep 16 12:48:10.207574 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.207501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:10.207574 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.207549    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:10.207756 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.207637    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:48:10.207756 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.207639    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:48:10.207756 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.207687    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:48:42.207673834 +0000 UTC m=+65.262891321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:48:10.207756 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.207699    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret podName:1b1f5c44-2abf-42b5-9c4a-a883723de2ef nodeName:}" failed. No retries permitted until 2026-09-16 12:48:42.20769399 +0000 UTC m=+65.262911476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret") pod "global-pull-secret-syncer-cf2n6" (UID: "1b1f5c44-2abf-42b5-9c4a-a883723de2ef") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:48:10.308322 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.308281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:10.308481 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.308464    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:48:10.308542 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.308490    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:48:10.308542 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.308505    2571 projected.go:196] Error preparing data for projected volume kube-api-access-wx66w for pod openshift-network-diagnostics/network-check-target-bcj6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:48:10.308642 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.308564    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w podName:e362580d-aba7-45a2-90ea-1f75850c89d8 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:42.308546626 +0000 UTC m=+65.363764126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx66w" (UniqueName: "kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w") pod "network-check-target-bcj6t" (UID: "e362580d-aba7-45a2-90ea-1f75850c89d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:48:10.427042 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.427016    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:10.427042 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.427035    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:10.427268 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:10.427035    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:10.427268 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.427129    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cf2n6" podUID="1b1f5c44-2abf-42b5-9c4a-a883723de2ef"
Sep 16 12:48:10.427268 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.427204    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bcj6t" podUID="e362580d-aba7-45a2-90ea-1f75850c89d8"
Sep 16 12:48:10.427390 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:10.427305    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hw5xf" podUID="b0a0792b-ccec-456b-88d2-b6fa4b2793dd"
Sep 16 12:48:11.303572 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.303541    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-158.ec2.internal" event="NodeReady"
Sep 16 12:48:11.303911 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.303650    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 12:48:11.345551 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.345483    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"]
Sep 16 12:48:11.368419 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.368393    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:48:11.368517 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.368506    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.373159 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.373137    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 12:48:11.373897 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.373876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 12:48:11.374039 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.373881    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 12:48:11.374781 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.374764    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vswfn\""
Sep 16 12:48:11.375943 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.374766    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 12:48:11.386439 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.386420    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"]
Sep 16 12:48:11.386587 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.386568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.402039 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.402019    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 12:48:11.402270 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.402075    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 12:48:11.402511 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.402495    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pwmxd\""
Sep 16 12:48:11.402716 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.402616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 12:48:11.404557 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.404537    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"]
Sep 16 12:48:11.404688 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.404668    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.412172 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.412154    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 12:48:11.412308 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.412226    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 12:48:11.412411 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.412231    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 12:48:11.412577 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.412562    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 12:48:11.413118 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.413087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 12:48:11.426581 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.426563    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"]
Sep 16 12:48:11.426676 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.426595    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-42j8j"]
Sep 16 12:48:11.426676 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.426668    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.429625 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.429604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 12:48:11.444783 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.444758    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.449351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.449180    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2p5px"]
Sep 16 12:48:11.449351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.449230    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 12:48:11.449351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.449251    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfdpm\""
Sep 16 12:48:11.449351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.449271    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 12:48:11.474686 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474662    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"]
Sep 16 12:48:11.474796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474702    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"]
Sep 16 12:48:11.474796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474725    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:48:11.474796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2p5px"]
Sep 16 12:48:11.474796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474761    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42j8j"]
Sep 16 12:48:11.474796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.474779    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.478224 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.478200    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 12:48:11.478326 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.478207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 12:48:11.478326 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.478298    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lxmf\""
Sep 16 12:48:11.478536 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.478518    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 12:48:11.517396 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517365    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1becb811-3996-42e5-8ddc-59d25b935b9e-tmp-dir\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.517493 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517416    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b3713-8cbc-48f2-a746-6477bee4c156-tmp\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.517493 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517493 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517516    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jqf2\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47nsz\" (UniqueName: \"kubernetes.io/projected/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-kube-api-access-47nsz\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517632    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.517673 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f363ea4f-a19d-49e6-9d15-f1af875e4d05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517796    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517854    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zsc8\" (UniqueName: \"kubernetes.io/projected/3b9b3713-8cbc-48f2-a746-6477bee4c156-kube-api-access-5zsc8\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1becb811-3996-42e5-8ddc-59d25b935b9e-config-volume\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517940    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqbrg\" (UniqueName: \"kubernetes.io/projected/f363ea4f-a19d-49e6-9d15-f1af875e4d05-kube-api-access-dqbrg\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.517979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.517967    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fvd\" (UniqueName: \"kubernetes.io/projected/1becb811-3996-42e5-8ddc-59d25b935b9e-kube-api-access-d9fvd\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.518278 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.518050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9b3713-8cbc-48f2-a746-6477bee4c156-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.518278 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.518094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.518278 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.518134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.593266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.593186    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:11.619074 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b3713-8cbc-48f2-a746-6477bee4c156-tmp\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.619074 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619238 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.619238 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619238 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jqf2\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619238 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:11.619172    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:11.619238 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:11.619238    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:12.119222395 +0000 UTC m=+35.174439887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:11.619464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47nsz\" (UniqueName: \"kubernetes.io/projected/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-kube-api-access-47nsz\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.619464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.619464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9b3713-8cbc-48f2-a746-6477bee4c156-tmp\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.619650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f363ea4f-a19d-49e6-9d15-f1af875e4d05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47thg\" (UniqueName: \"kubernetes.io/projected/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-kube-api-access-47thg\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.619650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619650 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zsc8\" (UniqueName: \"kubernetes.io/projected/3b9b3713-8cbc-48f2-a746-6477bee4c156-kube-api-access-5zsc8\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1becb811-3996-42e5-8ddc-59d25b935b9e-config-volume\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqbrg\" (UniqueName: \"kubernetes.io/projected/f363ea4f-a19d-49e6-9d15-f1af875e4d05-kube-api-access-dqbrg\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fvd\" (UniqueName: \"kubernetes.io/projected/1becb811-3996-42e5-8ddc-59d25b935b9e-kube-api-access-d9fvd\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.619844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.619808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-cert\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.620257 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f363ea4f-a19d-49e6-9d15-f1af875e4d05-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.620307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620276    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.620355 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9b3713-8cbc-48f2-a746-6477bee4c156-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.620402 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.620402 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.620486 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1becb811-3996-42e5-8ddc-59d25b935b9e-tmp-dir\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.620676 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.620656    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1becb811-3996-42e5-8ddc-59d25b935b9e-tmp-dir\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.621438 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.621411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624650    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:11.624801    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.624803    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b9b3713-8cbc-48f2-a746-6477bee4c156-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.624844 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:11.624816    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:11.625222 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:11.624935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:12.12491624 +0000 UTC m=+35.180133733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:11.625222 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.625105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1becb811-3996-42e5-8ddc-59d25b935b9e-config-volume\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.625222 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.625156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f363ea4f-a19d-49e6-9d15-f1af875e4d05-ca\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.628756 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.628732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jqf2\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.629652 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.629633    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:11.630007 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.629990    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47nsz\" (UniqueName: \"kubernetes.io/projected/bd31c172-e5a1-46c7-9de7-1f31ba6a93ee-kube-api-access-47nsz\") pod \"managed-serviceaccount-addon-agent-9c586d47d-kh7sg\" (UID: \"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.632996 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.632963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqbrg\" (UniqueName: \"kubernetes.io/projected/f363ea4f-a19d-49e6-9d15-f1af875e4d05-kube-api-access-dqbrg\") pod \"cluster-proxy-proxy-agent-b47bb867-fts5c\" (UID: \"f363ea4f-a19d-49e6-9d15-f1af875e4d05\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.633588 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.633541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fvd\" (UniqueName: \"kubernetes.io/projected/1becb811-3996-42e5-8ddc-59d25b935b9e-kube-api-access-d9fvd\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:11.633768 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.633747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zsc8\" (UniqueName: \"kubernetes.io/projected/3b9b3713-8cbc-48f2-a746-6477bee4c156-kube-api-access-5zsc8\") pod \"klusterlet-addon-workmgr-6bbb696757-ns48s\" (UID: \"3b9b3713-8cbc-48f2-a746-6477bee4c156\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.682756 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.682728    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:11.689538 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.689514    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"
Sep 16 12:48:11.714481 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.714458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:48:11.721948 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.721760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47thg\" (UniqueName: \"kubernetes.io/projected/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-kube-api-access-47thg\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.722051 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.721990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-cert\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.724820 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.724799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-cert\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.730425 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.730407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47thg\" (UniqueName: \"kubernetes.io/projected/b3a0023e-d500-4b14-86aa-ef9f42fe4c17-kube-api-access-47thg\") pod \"ingress-canary-2p5px\" (UID: \"b3a0023e-d500-4b14-86aa-ef9f42fe4c17\") " pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.752160 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.752063    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:11.784853 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.784652    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2p5px"
Sep 16 12:48:11.996415 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:11.996386    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg"]
Sep 16 12:48:12.000581 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.000548    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"]
Sep 16 12:48:12.001162 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:12.001010    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd31c172_e5a1_46c7_9de7_1f31ba6a93ee.slice/crio-cf262ece58cb9b53ec553636010433f54de3342158b4652a087450366e0963fb WatchSource:0}: Error finding container cf262ece58cb9b53ec553636010433f54de3342158b4652a087450366e0963fb: Status 404 returned error can't find the container with id cf262ece58cb9b53ec553636010433f54de3342158b4652a087450366e0963fb
Sep 16 12:48:12.002819 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:12.002792    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf363ea4f_a19d_49e6_9d15_f1af875e4d05.slice/crio-616febe2f3d75139f7337ae2c6a34843cdbef66d81009f8698e1e918959183d2 WatchSource:0}: Error finding container 616febe2f3d75139f7337ae2c6a34843cdbef66d81009f8698e1e918959183d2: Status 404 returned error can't find the container with id 616febe2f3d75139f7337ae2c6a34843cdbef66d81009f8698e1e918959183d2
Sep 16 12:48:12.057902 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.057855    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"]
Sep 16 12:48:12.060267 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:12.060242    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9b3713_8cbc_48f2_a746_6477bee4c156.slice/crio-6c73c697be76a1e05a748278a004724dd1c3d29995ebc61b1101a14810a71371 WatchSource:0}: Error finding container 6c73c697be76a1e05a748278a004724dd1c3d29995ebc61b1101a14810a71371: Status 404 returned error can't find the container with id 6c73c697be76a1e05a748278a004724dd1c3d29995ebc61b1101a14810a71371
Sep 16 12:48:12.078706 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.078647    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2p5px"]
Sep 16 12:48:12.082062 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:12.082039    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a0023e_d500_4b14_86aa_ef9f42fe4c17.slice/crio-5780d71051bea6f1ea1534c3c03b1974a38adf77e3c583541de57b154cc0810f WatchSource:0}: Error finding container 5780d71051bea6f1ea1534c3c03b1974a38adf77e3c583541de57b154cc0810f: Status 404 returned error can't find the container with id 5780d71051bea6f1ea1534c3c03b1974a38adf77e3c583541de57b154cc0810f
Sep 16 12:48:12.124487 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.124464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:12.124644 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:12.124628    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:12.124716 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:12.124695    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:13.124676314 +0000 UTC m=+36.179893818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:12.225398 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.225355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:12.225576 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:12.225468    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:12.225576 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:12.225490    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:12.225576 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:12.225553    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:13.225534527 +0000 UTC m=+36.280752026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:12.427585 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.427554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:12.427585 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.427571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:12.428161 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.427600    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:12.431173 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431151    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:48:12.431296 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431173    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9nrdj\""
Sep 16 12:48:12.431296 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431200    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:48:12.431296 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:48:12.431296 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431284    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m2lxw\""
Sep 16 12:48:12.431489 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.431480    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:48:12.638455 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.638428    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2p5px" event={"ID":"b3a0023e-d500-4b14-86aa-ef9f42fe4c17","Type":"ContainerStarted","Data":"5780d71051bea6f1ea1534c3c03b1974a38adf77e3c583541de57b154cc0810f"}
Sep 16 12:48:12.639484 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.639465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg" event={"ID":"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee","Type":"ContainerStarted","Data":"cf262ece58cb9b53ec553636010433f54de3342158b4652a087450366e0963fb"}
Sep 16 12:48:12.640536 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.640518    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s" event={"ID":"3b9b3713-8cbc-48f2-a746-6477bee4c156","Type":"ContainerStarted","Data":"6c73c697be76a1e05a748278a004724dd1c3d29995ebc61b1101a14810a71371"}
Sep 16 12:48:12.641604 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:12.641577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerStarted","Data":"616febe2f3d75139f7337ae2c6a34843cdbef66d81009f8698e1e918959183d2"}
Sep 16 12:48:13.132350 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:13.132301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:13.132517 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:13.132461    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:13.132578 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:13.132525    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:15.132506656 +0000 UTC m=+38.187724146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:13.233675 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:13.233645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:13.233836 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:13.233795    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:13.233836 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:13.233815    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:13.233956 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:13.233885    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:15.233857487 +0000 UTC m=+38.289074973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:14.896045 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:14.895967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:14.996352 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:14.996311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:15.097994 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.097960    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:15.148767 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.148684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:15.148944 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:15.148813    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:15.148944 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:15.148903    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:19.148881412 +0000 UTC m=+42.204098898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:15.249439 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.249410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:15.249610 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:15.249591    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:15.249671 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:15.249612    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:15.249671 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:15.249666    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:19.249652651 +0000 UTC m=+42.304870138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:15.659197 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.658375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2p5px" event={"ID":"b3a0023e-d500-4b14-86aa-ef9f42fe4c17","Type":"ContainerStarted","Data":"bf8d5ef7ca6ff9807e205f8e430fae0d806ba75d1adff43be7e531ae1cc3caec"}
Sep 16 12:48:15.673765 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.673736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerStarted","Data":"ff7dc101a8b43757d317885f27eda0e7ae4f001e2e64b5be9763e1c069e78373"}
Sep 16 12:48:15.977592 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:15.977510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:16.684205 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:16.683955    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="ff7dc101a8b43757d317885f27eda0e7ae4f001e2e64b5be9763e1c069e78373" exitCode=0
Sep 16 12:48:16.685958 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:16.685758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"ff7dc101a8b43757d317885f27eda0e7ae4f001e2e64b5be9763e1c069e78373"}
Sep 16 12:48:16.713614 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:16.713220    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2p5px" podStartSLOduration=2.411740633 podStartE2EDuration="5.713198849s" totalImagesPullingTime="3.301458216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:15.686964153 +0000 UTC m=+38.742181663" watchObservedRunningTime="2026-09-16 12:48:16.713198849 +0000 UTC m=+39.768416359"
Sep 16 12:48:17.351388 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:17.351264    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:17.691156 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:17.691114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerStarted","Data":"c440f509d8bddd2e35f054c7a6cb5faf543ada5b2e37c2a1305fc67b72b9435a"}
Sep 16 12:48:17.937310 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:17.937227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:18.007321 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:18.007249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:18.697138 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:18.697104    2571 generic.go:356] "Generic (PLEG): container finished" podID="759b6e1c-4047-4845-ab55-db7f80e64d4c" containerID="c440f509d8bddd2e35f054c7a6cb5faf543ada5b2e37c2a1305fc67b72b9435a" exitCode=0
Sep 16 12:48:18.697515 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:18.697150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerDied","Data":"c440f509d8bddd2e35f054c7a6cb5faf543ada5b2e37c2a1305fc67b72b9435a"}
Sep 16 12:48:18.884877 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:18.884820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:19.184680 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:19.184652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:19.184887 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:19.184767    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:19.184887 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:19.184816    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:27.184804264 +0000 UTC m=+50.240021751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:19.285104 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:19.285077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:19.285235 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:19.285219    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:19.285276 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:19.285237    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:19.285307 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:19.285284    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:27.285270548 +0000 UTC m=+50.340488049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:20.776241 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:20.776159    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:20.842693 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:20.842654    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:22.711279 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.711245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" event={"ID":"759b6e1c-4047-4845-ab55-db7f80e64d4c","Type":"ContainerStarted","Data":"3a3f38862b140d38738038e1ad416d1b05518263e8bd2566491ee4633a6db1a9"}
Sep 16 12:48:22.712711 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.712687    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg" event={"ID":"bd31c172-e5a1-46c7-9de7-1f31ba6a93ee","Type":"ContainerStarted","Data":"5f8bf8fc2d54e91837cf8da5b5f376234e8b057ff9e55bb10bfef8e006fc1554"}
Sep 16 12:48:22.714077 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.714052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s" event={"ID":"3b9b3713-8cbc-48f2-a746-6477bee4c156","Type":"ContainerStarted","Data":"7350d34d3ba24c0633f9e1701f195f1f092ddf43629349e7c0ade3e1b135d34e"}
Sep 16 12:48:22.714205 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.714181    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:22.716857 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.716453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s"
Sep 16 12:48:22.716857 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.716494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerStarted","Data":"87b22121da879e902ab69fb257559c98521a04b52be9af8fcde5421144f28b41"}
Sep 16 12:48:22.716857 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.716516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerStarted","Data":"64e87f72fdf2d1af029649acad08debf54393e290451a984e9ca9c11ee282c10"}
Sep 16 12:48:22.716857 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.716533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerStarted","Data":"a73b1ae5ed1de7e0df02f91e70b63dfea487987ddef121ed98f2980f596bb0c4"}
Sep 16 12:48:22.767060 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.767018    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c586d47d-kh7sg" podStartSLOduration=16.661664936 podStartE2EDuration="26.767006142s" totalImagesPullingTime="10.105341206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:22.766291831 +0000 UTC m=+45.821509338" watchObservedRunningTime="2026-09-16 12:48:22.767006142 +0000 UTC m=+45.822223642"
Sep 16 12:48:22.767416 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.767389    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z9zbp" podStartSLOduration=11.86967426 podStartE2EDuration="44.767380165s" totalImagesPullingTime="32.897705905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:22.744995848 +0000 UTC m=+45.800213356" watchObservedRunningTime="2026-09-16 12:48:22.767380165 +0000 UTC m=+45.822597672"
Sep 16 12:48:22.786192 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.786155    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb696757-ns48s" podStartSLOduration=16.667982315 podStartE2EDuration="26.786143042s" totalImagesPullingTime="10.118160727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:22.785785036 +0000 UTC m=+45.841002544" watchObservedRunningTime="2026-09-16 12:48:22.786143042 +0000 UTC m=+45.841360554"
Sep 16 12:48:22.821757 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.821719    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" podStartSLOduration=16.660858325 podStartE2EDuration="26.821707535s" totalImagesPullingTime="10.16084921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:22.813036704 +0000 UTC m=+45.868254211" watchObservedRunningTime="2026-09-16 12:48:22.821707535 +0000 UTC m=+45.876925040"
Sep 16 12:48:22.939434 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:22.939407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:23.036264 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:23.036192    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:26.537280 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:26.537242    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:26.608665 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:26.608632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:27.239617 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:27.239578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:27.239786 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:27.239715    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:27.239786 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:27.239775    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:48:43.239761391 +0000 UTC m=+66.294978876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:27.340776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:27.340744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:27.340913 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:27.340898    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:27.340953 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:27.340915    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:27.340982 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:27.340960    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:43.340948567 +0000 UTC m=+66.396166053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:31.036089 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:31.036052    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:31.143944 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:31.143858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:31.887984 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:31.887957    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:38.640595 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:38.640567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rwjbf"
Sep 16 12:48:38.805748 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:38.805710    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:38.902440 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:38.902356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:40.940732 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:40.940702    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:41.042979 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:41.042947    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:41.958396 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:41.958351    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:42.075799 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.075760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:42.249489 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.249403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:42.249635 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.249582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:48:42.252978 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.252958    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:48:42.253095 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.253080    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:48:42.260447 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:42.260416    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:48:42.260561 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:42.260488    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs podName:b0a0792b-ccec-456b-88d2-b6fa4b2793dd nodeName:}" failed. No retries permitted until 2026-09-16 12:49:46.260468313 +0000 UTC m=+129.315685813 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs") pod "network-metrics-daemon-hw5xf" (UID: "b0a0792b-ccec-456b-88d2-b6fa4b2793dd") : secret "metrics-daemon-secret" not found
Sep 16 12:48:42.263243 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.263222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b1f5c44-2abf-42b5-9c4a-a883723de2ef-original-pull-secret\") pod \"global-pull-secret-syncer-cf2n6\" (UID: \"1b1f5c44-2abf-42b5-9c4a-a883723de2ef\") " pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:42.350110 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.350073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:42.352904 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.352886    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:48:42.363384 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.363364    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:48:42.373675 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.373652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx66w\" (UniqueName: \"kubernetes.io/projected/e362580d-aba7-45a2-90ea-1f75850c89d8-kube-api-access-wx66w\") pod \"network-check-target-bcj6t\" (UID: \"e362580d-aba7-45a2-90ea-1f75850c89d8\") " pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:42.445592 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.445564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m2lxw\""
Sep 16 12:48:42.452210 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.452183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:42.455900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.455884    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cf2n6"
Sep 16 12:48:42.734266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.734089    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cf2n6"]
Sep 16 12:48:42.737060 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:42.737023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1f5c44_2abf_42b5_9c4a_a883723de2ef.slice/crio-1360d69cce9fd7805a86dec4bceaa61be6254a9e3721df72484ebfbd08ab917e WatchSource:0}: Error finding container 1360d69cce9fd7805a86dec4bceaa61be6254a9e3721df72484ebfbd08ab917e: Status 404 returned error can't find the container with id 1360d69cce9fd7805a86dec4bceaa61be6254a9e3721df72484ebfbd08ab917e
Sep 16 12:48:42.737770 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.737745    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bcj6t"]
Sep 16 12:48:42.740106 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:48:42.740084    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode362580d_aba7_45a2_90ea_1f75850c89d8.slice/crio-19ca30bc7829a2c812ef8a33011bb0b775b1b79979664f48a90ec866588ad363 WatchSource:0}: Error finding container 19ca30bc7829a2c812ef8a33011bb0b775b1b79979664f48a90ec866588ad363: Status 404 returned error can't find the container with id 19ca30bc7829a2c812ef8a33011bb0b775b1b79979664f48a90ec866588ad363
Sep 16 12:48:42.775427 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.775344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcj6t" event={"ID":"e362580d-aba7-45a2-90ea-1f75850c89d8","Type":"ContainerStarted","Data":"19ca30bc7829a2c812ef8a33011bb0b775b1b79979664f48a90ec866588ad363"}
Sep 16 12:48:42.776338 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:42.776319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cf2n6" event={"ID":"1b1f5c44-2abf-42b5-9c4a-a883723de2ef","Type":"ContainerStarted","Data":"1360d69cce9fd7805a86dec4bceaa61be6254a9e3721df72484ebfbd08ab917e"}
Sep 16 12:48:43.256397 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:43.256364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:48:43.256800 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:43.256505    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:48:43.256800 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:43.256567    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls podName:1becb811-3996-42e5-8ddc-59d25b935b9e nodeName:}" failed. No retries permitted until 2026-09-16 12:49:15.256549601 +0000 UTC m=+98.311767087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls") pod "dns-default-42j8j" (UID: "1becb811-3996-42e5-8ddc-59d25b935b9e") : secret "dns-default-metrics-tls" not found
Sep 16 12:48:43.357090 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:43.357056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:48:43.357267 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:43.357203    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 12:48:43.357267 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:43.357218    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fcf77ddd-k668w: secret "image-registry-tls" not found
Sep 16 12:48:43.357359 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:43.357273    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls podName:812add76-9d5b-4f0f-9634-b1ea244b2a64 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:15.35725762 +0000 UTC m=+98.412475119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls") pod "image-registry-66fcf77ddd-k668w" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64") : secret "image-registry-tls" not found
Sep 16 12:48:43.989899 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:43.989796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:44.062604 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:44.062571    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:46.997124 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:46.997088    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kf9s5"]
Sep 16 12:48:47.002049 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.000967    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.004215 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.004191    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 12:48:47.004370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.004219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 12:48:47.004370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.004256    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zmc7\""
Sep 16 12:48:47.004370 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.004305    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 12:48:47.005265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.005245    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 12:48:47.024879 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.024832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf9s5"]
Sep 16 12:48:47.083854 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.083821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f3a2586-31c9-46a4-bd01-502b273de9f0-crio-socket\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.083854 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.083850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f3a2586-31c9-46a4-bd01-502b273de9f0-data-volume\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.084082 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.083953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.084082 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.084018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.084082 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.084069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94krq\" (UniqueName: \"kubernetes.io/projected/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-api-access-94krq\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.134132 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.134091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:47.185016 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.184980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185016 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94krq\" (UniqueName: \"kubernetes.io/projected/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-api-access-94krq\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f3a2586-31c9-46a4-bd01-502b273de9f0-crio-socket\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.185123    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f3a2586-31c9-46a4-bd01-502b273de9f0-data-volume\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.185222    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:47.68519925 +0000 UTC m=+70.740416773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : configmap "kube-rbac-proxy" not found
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f3a2586-31c9-46a4-bd01-502b273de9f0-crio-socket\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.185255 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.185233    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:47.185565 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.185294    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:47.685276657 +0000 UTC m=+70.740494144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:47.185565 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.185508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f3a2586-31c9-46a4-bd01-502b273de9f0-data-volume\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.210341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.210308    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94krq\" (UniqueName: \"kubernetes.io/projected/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-api-access-94krq\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.353360 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.353266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:47.558818 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.558787    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:47.689846 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.689807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.690024 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.689876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:47.690024 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.689935    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:48:47.690024 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.690010    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:48.689992262 +0000 UTC m=+71.745209767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : configmap "kube-rbac-proxy" not found
Sep 16 12:48:47.690246 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.690045    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:47.690246 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:47.690112    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:48.690095686 +0000 UTC m=+71.745313188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:47.783552 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.783515    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:47.794293 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.794256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bcj6t" event={"ID":"e362580d-aba7-45a2-90ea-1f75850c89d8","Type":"ContainerStarted","Data":"121c6e6c9e834488553055fa7f38278e678679c24bc94cb05fc63d8848ac637b"}
Sep 16 12:48:47.794478 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.794436    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:48:47.795729 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.795708    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cf2n6" event={"ID":"1b1f5c44-2abf-42b5-9c4a-a883723de2ef","Type":"ContainerStarted","Data":"91ca650ec8f780a9c2d997100ca72913bf8b5dd81fa0e39942a76ccd6916e982"}
Sep 16 12:48:47.817495 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.817449    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bcj6t" podStartSLOduration=65.102220971 podStartE2EDuration="1m9.817433705s" totalImagesPullingTime="4.715212734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:47.816917357 +0000 UTC m=+70.872134865" watchObservedRunningTime="2026-09-16 12:48:47.817433705 +0000 UTC m=+70.872651191"
Sep 16 12:48:47.842094 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.842047    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cf2n6" podStartSLOduration=65.119815172 podStartE2EDuration="1m9.842031564s" totalImagesPullingTime="4.722216392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:47.841336266 +0000 UTC m=+70.896553774" watchObservedRunningTime="2026-09-16 12:48:47.842031564 +0000 UTC m=+70.897249072"
Sep 16 12:48:47.904595 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:47.904564    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:48.190644 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:48.190608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:48.314502 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:48.314474    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:48.696814 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:48.696782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:48.696992 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:48.696822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:48.696992 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:48.696938    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:48:48.697068 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:48.697004    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:48.697068 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:48.697010    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:50.696992476 +0000 UTC m=+73.752209975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : configmap "kube-rbac-proxy" not found
Sep 16 12:48:48.697068 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:48.697039    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:50.697029598 +0000 UTC m=+73.752247084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:49.132381 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:49.132305    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbfkt_2012aa80-b2f4-43a7-b039-790ec85dd647/dns-node-resolver/0.log"
Sep 16 12:48:49.738286 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:49.738262    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59cfr_559aa60c-8f8d-44a2-a7f9-e46d0dcb1219/node-ca/0.log"
Sep 16 12:48:49.890645 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:49.890608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:49.990274 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:49.990186    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:50.530576 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:50.530547    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2p5px_b3a0023e-d500-4b14-86aa-ef9f42fe4c17/serve-healthcheck-canary/0.log"
Sep 16 12:48:50.713261 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:50.713224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:50.713261 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:50.713269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:50.713480 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:50.713359    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:48:50.713480 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:50.713382    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:50.713480 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:50.713429    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:54.713410457 +0000 UTC m=+77.768627961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:50.713480 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:50.713445    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:54.713436613 +0000 UTC m=+77.768654099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : configmap "kube-rbac-proxy" not found
Sep 16 12:48:51.476329 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:51.476289    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:51.626086 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:51.626055    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:51.962180 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:51.962150    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.128060 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:52.128023    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.293020 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:52.292935    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.427323 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:52.427280    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.546587 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:52.546480    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.737602 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:52.737574    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:53.711431 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:53.711397    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.072204 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:54.072120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.265768 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:54.265738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.472089 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:54.472041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.744636 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:54.744558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:54.744636 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:54.744601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:48:54.745058 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:54.744680    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:48:54.745058 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:54.744723    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:54.745058 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:54.744763    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:02.744745528 +0000 UTC m=+85.799963027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : configmap "kube-rbac-proxy" not found
Sep 16 12:48:54.745058 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:48:54.744784    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls podName:0f3a2586-31c9-46a4-bd01-502b273de9f0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:02.74477451 +0000 UTC m=+85.799992006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kf9s5" (UID: "0f3a2586-31c9-46a4-bd01-502b273de9f0") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:48:55.168879 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:55.168759    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:55.273135 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:55.273102    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:55.589116 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:55.589080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:55.693652 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:55.693618    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:55.844004 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:55.843918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:56.061619 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:56.061587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:56.274839 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:56.274806    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:56.479776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:56.479742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:56.676736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:56.676709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:56.930111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:56.930011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:57.853169 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:57.853141    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.042246 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:58.042213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.245369 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:58.245336    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.452598 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:58.452551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.552574 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:58.552489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.653743 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:58.653712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:59.655000 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:48:59.654963    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:00.055090 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:00.054977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:00.155588 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:00.155553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:00.272898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:00.272846    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:00.481416 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:00.481379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:00.647163 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:00.647108    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:01.211237 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:01.211204    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:01.310246 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:01.310210    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:01.850566 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:01.850538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:02.057222 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.057190    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:02.241791 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.241755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:02.442847 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.442808    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:02.636914 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.636805    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:02.808921 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.808889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:49:02.809097 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.808990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:49:02.809444 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.809428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f3a2586-31c9-46a4-bd01-502b273de9f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:49:02.811233 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.811210    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f3a2586-31c9-46a4-bd01-502b273de9f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kf9s5\" (UID: \"0f3a2586-31c9-46a4-bd01-502b273de9f0\") " pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:49:02.912715 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:02.912627    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kf9s5"
Sep 16 12:49:03.183528 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:03.183506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kf9s5"]
Sep 16 12:49:03.185894 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:49:03.185846    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3a2586_31c9_46a4_bd01_502b273de9f0.slice/crio-d4323c440fa30c40665837fd05b749930ede4bfb1633968a8f6652b088158f61 WatchSource:0}: Error finding container d4323c440fa30c40665837fd05b749930ede4bfb1633968a8f6652b088158f61: Status 404 returned error can't find the container with id d4323c440fa30c40665837fd05b749930ede4bfb1633968a8f6652b088158f61
Sep 16 12:49:03.844298 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:03.844264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf9s5" event={"ID":"0f3a2586-31c9-46a4-bd01-502b273de9f0","Type":"ContainerStarted","Data":"6eef1d727ed2da1206ab182bf09228e0ca905ad58d82e0c41ba470e8b3f1fcb8"}
Sep 16 12:49:03.844659 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:03.844325    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf9s5" event={"ID":"0f3a2586-31c9-46a4-bd01-502b273de9f0","Type":"ContainerStarted","Data":"d4323c440fa30c40665837fd05b749930ede4bfb1633968a8f6652b088158f61"}
Sep 16 12:49:04.852307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:04.852274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf9s5" event={"ID":"0f3a2586-31c9-46a4-bd01-502b273de9f0","Type":"ContainerStarted","Data":"2fced068e8f7c713e7276d2a0ce8dfa10c19327d2b9346bf34b7d0f5a1b21c3f"}
Sep 16 12:49:05.503377 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:05.503339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:05.625182 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:05.625143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:05.806680 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:05.806592    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:05.971672 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:05.971642    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:06.098897 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.098799    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:06.201337 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.201304    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:06.395636 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.395548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:06.489593 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.489562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:06.861874 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.861832    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kf9s5" event={"ID":"0f3a2586-31c9-46a4-bd01-502b273de9f0","Type":"ContainerStarted","Data":"8dabe101691a4a6f6d36f16112f4f8df7d59694e52812be8d4706f18950c34e5"}
Sep 16 12:49:06.880796 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:06.880743    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kf9s5" podStartSLOduration=18.224656234 podStartE2EDuration="20.880726533s" totalImagesPullingTime="2.656070299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:48:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:06.880681918 +0000 UTC m=+89.935899425" watchObservedRunningTime="2026-09-16 12:49:06.880726533 +0000 UTC m=+89.935944041"
Sep 16 12:49:07.173100 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:07.173065    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:07.247023 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:07.246992    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:07.365445 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:07.365412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:07.551930 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:07.551830    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:07.618814 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:07.618781    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:11.594558 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:11.594525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:11.665824 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:11.665774    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:13.162913 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:13.162879    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:13.337494 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:13.337446    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:13.486373 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:13.486340    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:13.624885 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:13.624838    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:15.188587 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.188558    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:15.288846 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.288817    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:15.319245 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.319208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:49:15.321558 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.321531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1becb811-3996-42e5-8ddc-59d25b935b9e-metrics-tls\") pod \"dns-default-42j8j\" (UID: \"1becb811-3996-42e5-8ddc-59d25b935b9e\") " pod="openshift-dns/dns-default-42j8j"
Sep 16 12:49:15.360171 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.360142    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfdpm\""
Sep 16 12:49:15.367898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.367875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42j8j"
Sep 16 12:49:15.420324 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.420299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:49:15.422755 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.422728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"image-registry-66fcf77ddd-k668w\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") " pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:49:15.599736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.599648    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pwmxd\""
Sep 16 12:49:15.606841 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.606820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:49:15.649646 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.649610    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42j8j"]
Sep 16 12:49:15.651660 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:49:15.651630    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1becb811_3996_42e5_8ddc_59d25b935b9e.slice/crio-db84cd61e449924c3f595a1dbc596965b226a35af02b39aaa4efb4d9ec8a9de0 WatchSource:0}: Error finding container db84cd61e449924c3f595a1dbc596965b226a35af02b39aaa4efb4d9ec8a9de0: Status 404 returned error can't find the container with id db84cd61e449924c3f595a1dbc596965b226a35af02b39aaa4efb4d9ec8a9de0
Sep 16 12:49:15.889139 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.889054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42j8j" event={"ID":"1becb811-3996-42e5-8ddc-59d25b935b9e","Type":"ContainerStarted","Data":"db84cd61e449924c3f595a1dbc596965b226a35af02b39aaa4efb4d9ec8a9de0"}
Sep 16 12:49:15.902760 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:15.900159    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:49:15.904031 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:49:15.904003    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812add76_9d5b_4f0f_9634_b1ea244b2a64.slice/crio-5d93df973b38c41c299c6e8396b404c5a80023e31ecb7a91dee8962249796b4f WatchSource:0}: Error finding container 5d93df973b38c41c299c6e8396b404c5a80023e31ecb7a91dee8962249796b4f: Status 404 returned error can't find the container with id 5d93df973b38c41c299c6e8396b404c5a80023e31ecb7a91dee8962249796b4f
Sep 16 12:49:16.753303 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.753271    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:16.881294 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.881261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:16.894621 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.894585    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" event={"ID":"812add76-9d5b-4f0f-9634-b1ea244b2a64","Type":"ContainerStarted","Data":"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"}
Sep 16 12:49:16.894803 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.894645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" event={"ID":"812add76-9d5b-4f0f-9634-b1ea244b2a64","Type":"ContainerStarted","Data":"5d93df973b38c41c299c6e8396b404c5a80023e31ecb7a91dee8962249796b4f"}
Sep 16 12:49:16.894803 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.894674    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:49:16.938098 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.938033    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" podStartSLOduration=77.938010072 podStartE2EDuration="1m17.938010072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:16.936084434 +0000 UTC m=+99.991301943" watchObservedRunningTime="2026-09-16 12:49:16.938010072 +0000 UTC m=+99.993227581"
Sep 16 12:49:16.999571 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:16.999522    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:17.785369 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:17.785317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:17.899260 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:17.899207    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42j8j" event={"ID":"1becb811-3996-42e5-8ddc-59d25b935b9e","Type":"ContainerStarted","Data":"807d7cf7ae7006a0f04cddd98248495e31389b03943b7e696b2ff9f7efead620"}
Sep 16 12:49:17.899452 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:17.899279    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42j8j" event={"ID":"1becb811-3996-42e5-8ddc-59d25b935b9e","Type":"ContainerStarted","Data":"572c1b04095926f09d99f44ab8207d780b821497bdcdcde3df381147071b1ed9"}
Sep 16 12:49:17.928726 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:17.928676    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-42j8j" podStartSLOduration=65.483426813 podStartE2EDuration="1m6.928660315s" totalImagesPullingTime="1.445233502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:17.928401623 +0000 UTC m=+100.983619144" watchObservedRunningTime="2026-09-16 12:49:17.928660315 +0000 UTC m=+100.983877823"
Sep 16 12:49:18.801197 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:18.801164    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bcj6t"
Sep 16 12:49:18.902597 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:18.902564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-42j8j"
Sep 16 12:49:19.978677 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:19.978641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:20.128829 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:20.128778    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:20.431256 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:20.431225    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:20.530817 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:20.530777    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:21.984474 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:21.984424    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:22.082677 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:22.082639    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:22.390144 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:22.389664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:22.942367 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:22.942331    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:23.012022 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:23.011988    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:24.014607 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:24.014570    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:24.121351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:24.121318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:27.124091 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:27.124059    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:27.301683 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:27.301647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:28.908568 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:28.908539    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-42j8j"
Sep 16 12:49:29.625397 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:29.625357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:29.722106 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:29.722073    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:31.237928 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:31.237894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:31.338609 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:31.338578    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:32.024684 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:32.024656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:32.132859 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:32.132827    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:32.482648 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:32.482616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:32.798071 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:32.797967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:32.900579 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:32.900549    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:33.604332 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:33.604296    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:33.703714 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:33.703678    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.202362 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.202325    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.223501 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.223472    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:49:35.227730 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.227710    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:49:35.496723 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.496615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.545716 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.545681    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tjw5x"]
Sep 16 12:49:35.548732 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.548710    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.551628 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.551595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:49:35.551760 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.551629    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xr86w\""
Sep 16 12:49:35.551760 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.551670    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 12:49:35.551760 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.551729    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:49:35.552107 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.552087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 12:49:35.552811 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.552796    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:49:35.552908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.552817    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 12:49:35.596644 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.596615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.674003 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.673973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674020    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-textfile\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-root\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674100    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-sys\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674174 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-metrics-client-ca\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674389 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674222    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-wtmp\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.674389 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.674245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fwmk\" (UniqueName: \"kubernetes.io/projected/fb8f8b3e-9415-4634-9852-2c3c04c529c6-kube-api-access-6fwmk\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.701141 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.701101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.775322 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-wtmp\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775322 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fwmk\" (UniqueName: \"kubernetes.io/projected/fb8f8b3e-9415-4634-9852-2c3c04c529c6-kube-api-access-6fwmk\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775322 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-textfile\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-wtmp\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-root\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:49:35.775455    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-root\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775590 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:49:35.775577    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls podName:fb8f8b3e-9415-4634-9852-2c3c04c529c6 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:36.275552868 +0000 UTC m=+119.330770359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls") pod "node-exporter-tjw5x" (UID: "fb8f8b3e-9415-4634-9852-2c3c04c529c6") : secret "node-exporter-tls" not found
Sep 16 12:49:35.775900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-sys\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb8f8b3e-9415-4634-9852-2c3c04c529c6-sys\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-metrics-client-ca\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.775900 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-textfile\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.776037 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.775987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.776138 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.776122    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8f8b3e-9415-4634-9852-2c3c04c529c6-metrics-client-ca\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.777633 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.777616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.787136 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.787110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fwmk\" (UniqueName: \"kubernetes.io/projected/fb8f8b3e-9415-4634-9852-2c3c04c529c6-kube-api-access-6fwmk\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:35.804124 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.804092    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:35.905487 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:35.905456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.005482 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.005443    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.105169 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.105080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.211635 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.211598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.280346 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.280314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:36.280504 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:49:36.280464    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 12:49:36.280577 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:49:36.280566    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls podName:fb8f8b3e-9415-4634-9852-2c3c04c529c6 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:37.280546899 +0000 UTC m=+120.335764384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls") pod "node-exporter-tjw5x" (UID: "fb8f8b3e-9415-4634-9852-2c3c04c529c6") : secret "node-exporter-tls" not found
Sep 16 12:49:36.470758 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.470726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.761705 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:36.761617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:37.004235 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.004206    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:37.288662 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.288624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:37.290939 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.290921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb8f8b3e-9415-4634-9852-2c3c04c529c6-node-exporter-tls\") pod \"node-exporter-tjw5x\" (UID: \"fb8f8b3e-9415-4634-9852-2c3c04c529c6\") " pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:37.361156 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.361126    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xr86w\""
Sep 16 12:49:37.368517 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.368499    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tjw5x"
Sep 16 12:49:37.379639 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:49:37.379604    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8f8b3e_9415_4634_9852_2c3c04c529c6.slice/crio-56de32beac1e418bb3cc0504867f87e7e14e7a846dd5c27f566eb515e108637b WatchSource:0}: Error finding container 56de32beac1e418bb3cc0504867f87e7e14e7a846dd5c27f566eb515e108637b: Status 404 returned error can't find the container with id 56de32beac1e418bb3cc0504867f87e7e14e7a846dd5c27f566eb515e108637b
Sep 16 12:49:37.752829 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.752796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:37.963196 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:37.963158    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjw5x" event={"ID":"fb8f8b3e-9415-4634-9852-2c3c04c529c6","Type":"ContainerStarted","Data":"56de32beac1e418bb3cc0504867f87e7e14e7a846dd5c27f566eb515e108637b"}
Sep 16 12:49:38.209173 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.209134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.309190 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.309132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.415136 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.415105    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.511665 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.511585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.612015 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.611987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.711378 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.711344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.793141 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.793049    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:38.968211 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.968176    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb8f8b3e-9415-4634-9852-2c3c04c529c6" containerID="3d24986066c6e7457b6efb9c93fb50c64033973fcc0c008ef9580d4acb68f0ba" exitCode=0
Sep 16 12:49:38.968375 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:38.968263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjw5x" event={"ID":"fb8f8b3e-9415-4634-9852-2c3c04c529c6","Type":"ContainerDied","Data":"3d24986066c6e7457b6efb9c93fb50c64033973fcc0c008ef9580d4acb68f0ba"}
Sep 16 12:49:39.973550 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:39.973516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjw5x" event={"ID":"fb8f8b3e-9415-4634-9852-2c3c04c529c6","Type":"ContainerStarted","Data":"88d7e117c3c71e1b4c4462b84b2bf72ba2b07ba61d199a6ea21cba55945c4c74"}
Sep 16 12:49:39.974043 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:39.973571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tjw5x" event={"ID":"fb8f8b3e-9415-4634-9852-2c3c04c529c6","Type":"ContainerStarted","Data":"4074d8a7c27dd0c268cce329c8afc432c1a948ff8a1c56bbe88b3b7535fee725"}
Sep 16 12:49:39.998167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:39.998119    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tjw5x" podStartSLOduration=4.009744522 podStartE2EDuration="4.998081197s" totalImagesPullingTime="926.831652ms" totalInitContainerRuntime="61.505023ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:39.996960894 +0000 UTC m=+123.052178401" watchObservedRunningTime="2026-09-16 12:49:39.998081197 +0000 UTC m=+123.053298745"
Sep 16 12:49:40.173393 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:40.173358    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:40.295510 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:40.295425    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:40.443290 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:40.443249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:40.543996 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:40.543949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:40.676898 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:40.676849    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:41.716473 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:41.716430    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" podUID="f363ea4f-a19d-49e6-9d15-f1af875e4d05" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:49:41.840539 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:41.840496    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:45.364048 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:45.364015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:45.462036 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:45.461999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:46.210949 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.210916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:46.312528 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.312502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:46.354679 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.354653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:49:46.356921 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.356900    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0a0792b-ccec-456b-88d2-b6fa4b2793dd-metrics-certs\") pod \"network-metrics-daemon-hw5xf\" (UID: \"b0a0792b-ccec-456b-88d2-b6fa4b2793dd\") " pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:49:46.660118 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.660044    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9nrdj\""
Sep 16 12:49:46.670009 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.669985    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hw5xf"
Sep 16 12:49:46.939356 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.939333    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hw5xf"]
Sep 16 12:49:46.941749 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:49:46.941727    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a0792b_ccec_456b_88d2_b6fa4b2793dd.slice/crio-bbf6a12273b6d6e1d4fdeeea1d7862c7e2f6c33ea3bda9c6d5027aef493ff97a WatchSource:0}: Error finding container bbf6a12273b6d6e1d4fdeeea1d7862c7e2f6c33ea3bda9c6d5027aef493ff97a: Status 404 returned error can't find the container with id bbf6a12273b6d6e1d4fdeeea1d7862c7e2f6c33ea3bda9c6d5027aef493ff97a
Sep 16 12:49:46.996519 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:46.996484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hw5xf" event={"ID":"b0a0792b-ccec-456b-88d2-b6fa4b2793dd","Type":"ContainerStarted","Data":"bbf6a12273b6d6e1d4fdeeea1d7862c7e2f6c33ea3bda9c6d5027aef493ff97a"}
Sep 16 12:49:47.159474 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:47.159444    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:47.252701 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:47.252626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:49.005491 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:49.005459    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hw5xf" event={"ID":"b0a0792b-ccec-456b-88d2-b6fa4b2793dd","Type":"ContainerStarted","Data":"67be88f98902c0b1ebf3441c71858e91b22b68f41295e6f456a3fa0eb02764c4"}
Sep 16 12:49:49.005886 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:49.005507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hw5xf" event={"ID":"b0a0792b-ccec-456b-88d2-b6fa4b2793dd","Type":"ContainerStarted","Data":"bb50d1caed59572b14a923e4d5976a897f82a6154492545ab290c0c51f9a732b"}
Sep 16 12:49:49.025628 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:49.025573    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hw5xf" podStartSLOduration=129.998482287 podStartE2EDuration="2m11.025558304s" totalImagesPullingTime="1.027076017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:49.023474696 +0000 UTC m=+132.078692204" watchObservedRunningTime="2026-09-16 12:49:49.025558304 +0000 UTC m=+132.080775811"
Sep 16 12:49:49.163078 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:49.163048    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:49.232344 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:49.232312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:51.715769 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:51.715731    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" podUID="f363ea4f-a19d-49e6-9d15-f1af875e4d05" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:49:53.309971 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:53.309936    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:53.384066 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:53.384033    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:59.280350 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:59.280303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:59.445146 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:59.445116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:59.540876 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:59.540795    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:59.606175 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:49:59.606144    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:00.242340 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.242293    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" podUID="812add76-9d5b-4f0f-9634-b1ea244b2a64" containerName="registry" containerID="cri-o://01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91" gracePeriod=30
Sep 16 12:50:00.471266 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.471243    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:50:00.550919 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.550848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.550919 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.550896    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jqf2\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.550919 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.550916    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551164 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.550937    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551164 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.550964    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551164 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.551024    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.551169    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.551211    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets\") pod \"812add76-9d5b-4f0f-9634-b1ea244b2a64\" (UID: \"812add76-9d5b-4f0f-9634-b1ea244b2a64\") "
Sep 16 12:50:00.551411 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.551366    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:50:00.551519 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.551476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:50:00.553459 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.553431    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:50:00.553577 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.553549    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:50:00.553656 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.553575    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:50:00.553785 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.553767    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:50:00.553835 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.553811    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2" (OuterVolumeSpecName: "kube-api-access-9jqf2") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "kube-api-access-9jqf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:50:00.559768 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.559740    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "812add76-9d5b-4f0f-9634-b1ea244b2a64" (UID: "812add76-9d5b-4f0f-9634-b1ea244b2a64"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:50:00.652105 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652066    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-bound-sa-token\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652105 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652104    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-image-registry-private-configuration\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652105 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652114    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/812add76-9d5b-4f0f-9634-b1ea244b2a64-installation-pull-secrets\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652125    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-certificates\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652135    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jqf2\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-kube-api-access-9jqf2\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652143    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/812add76-9d5b-4f0f-9634-b1ea244b2a64-registry-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652151    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/812add76-9d5b-4f0f-9634-b1ea244b2a64-ca-trust-extracted\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:00.652265 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:00.652158    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/812add76-9d5b-4f0f-9634-b1ea244b2a64-trusted-ca\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:50:01.049963 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.049924    2571 generic.go:356] "Generic (PLEG): container finished" podID="812add76-9d5b-4f0f-9634-b1ea244b2a64" containerID="01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91" exitCode=0
Sep 16 12:50:01.050130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.049980    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w"
Sep 16 12:50:01.050130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.050009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" event={"ID":"812add76-9d5b-4f0f-9634-b1ea244b2a64","Type":"ContainerDied","Data":"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"}
Sep 16 12:50:01.050130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.050061    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fcf77ddd-k668w" event={"ID":"812add76-9d5b-4f0f-9634-b1ea244b2a64","Type":"ContainerDied","Data":"5d93df973b38c41c299c6e8396b404c5a80023e31ecb7a91dee8962249796b4f"}
Sep 16 12:50:01.050130 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.050081    2571 scope.go:117] "RemoveContainer" containerID="01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"
Sep 16 12:50:01.058840 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.058823    2571 scope.go:117] "RemoveContainer" containerID="01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"
Sep 16 12:50:01.059224 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:50:01.059202    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91\": container with ID starting with 01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91 not found: ID does not exist" containerID="01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"
Sep 16 12:50:01.059297 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.059231    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91"} err="failed to get container status \"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91\": rpc error: code = NotFound desc = could not find container \"01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91\": container with ID starting with 01019f394977ed547a6d2a9adce6afe6bbdccad1280d2d249a154443a39f5f91 not found: ID does not exist"
Sep 16 12:50:01.071952 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.071926    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:50:01.075691 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.075668    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66fcf77ddd-k668w"]
Sep 16 12:50:01.254223 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.254192    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:01.355287 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.355199    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:01.431732 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.431704    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="812add76-9d5b-4f0f-9634-b1ea244b2a64" path="/var/lib/kubelet/pods/812add76-9d5b-4f0f-9634-b1ea244b2a64/volumes"
Sep 16 12:50:01.716645 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.716611    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" podUID="f363ea4f-a19d-49e6-9d15-f1af875e4d05" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:50:01.717161 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.716677    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c"
Sep 16 12:50:01.717214 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.717165    2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"87b22121da879e902ab69fb257559c98521a04b52be9af8fcde5421144f28b41"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 16 12:50:01.717214 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:01.717205    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" podUID="f363ea4f-a19d-49e6-9d15-f1af875e4d05" containerName="service-proxy" containerID="cri-o://87b22121da879e902ab69fb257559c98521a04b52be9af8fcde5421144f28b41" gracePeriod=30
Sep 16 12:50:02.055843 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:02.055754    2571 generic.go:356] "Generic (PLEG): container finished" podID="f363ea4f-a19d-49e6-9d15-f1af875e4d05" containerID="87b22121da879e902ab69fb257559c98521a04b52be9af8fcde5421144f28b41" exitCode=2
Sep 16 12:50:02.055843 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:02.055804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerDied","Data":"87b22121da879e902ab69fb257559c98521a04b52be9af8fcde5421144f28b41"}
Sep 16 12:50:02.055843 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:02.055834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b47bb867-fts5c" event={"ID":"f363ea4f-a19d-49e6-9d15-f1af875e4d05","Type":"ContainerStarted","Data":"a1c7dd8f3d343985da4f05be68f938ced491b7419cc62ed67eb8dc45ccb813ef"}
Sep 16 12:50:04.598993 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:04.598956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:04.893070 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:04.892983    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:16.209781 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:16.209744    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:16.276860 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:16.276785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:34.405860 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:34.405775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:51.641059 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:51.641022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:51.766981 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:50:51.766945    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:02.376516 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:02.376485    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:02.433859 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:02.433821    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:03.587754 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:03.587713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:03.688583 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:03.688551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:12.768415 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:12.768376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:12.868756 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:12.868718    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:12.939704 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:12.939661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:16.357217 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:16.357136    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:16.458717 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:51:16.458670    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:31.707814 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:31.707775    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:31.763574 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:31.763548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:37.367461 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:37.367434    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:52:37.373332 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:37.373305    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:52:37.374600 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:37.374570    2571 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 12:52:51.491545 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:51.491504    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:51.590228 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:51.590194    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:51.692637 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:51.692600    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:52.707409 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.707373    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"]
Sep 16 12:52:52.707776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.707591    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812add76-9d5b-4f0f-9634-b1ea244b2a64" containerName="registry"
Sep 16 12:52:52.707776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.707610    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="812add76-9d5b-4f0f-9634-b1ea244b2a64" containerName="registry"
Sep 16 12:52:52.707776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.707682    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="812add76-9d5b-4f0f-9634-b1ea244b2a64" containerName="registry"
Sep 16 12:52:52.710417 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.710402    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.713584 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.713563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:52:52.713708 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.713603    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:52:52.714750 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.714732    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wgk4j\""
Sep 16 12:52:52.722729 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.722705    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"]
Sep 16 12:52:52.744133 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.744111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgdpj\" (UniqueName: \"kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.744226 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.744147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.744226 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.744169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.844780 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.844756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgdpj\" (UniqueName: \"kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.844966 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.844789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.844966 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.844808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.845238 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.845219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.845274 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.845237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:52.855427 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:52.855401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgdpj\" (UniqueName: \"kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:53.019154 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:53.019086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:52:53.289164 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:53.289098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"]
Sep 16 12:52:53.292514 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:52:53.292486    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4f86a1_097a_47d0_8a07_0026141276e7.slice/crio-43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af WatchSource:0}: Error finding container 43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af: Status 404 returned error can't find the container with id 43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af
Sep 16 12:52:53.294516 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:53.294501    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:52:53.604903 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:53.604807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb" event={"ID":"5d4f86a1-097a-47d0-8a07-0026141276e7","Type":"ContainerStarted","Data":"43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af"}
Sep 16 12:52:59.628931 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:59.628895    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerID="d693fdbd6ab2e39081d44835883a70d9a75cfff6ebba88bb01d0cf3da212ff9e" exitCode=0
Sep 16 12:52:59.629324 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:52:59.628979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb" event={"ID":"5d4f86a1-097a-47d0-8a07-0026141276e7","Type":"ContainerDied","Data":"d693fdbd6ab2e39081d44835883a70d9a75cfff6ebba88bb01d0cf3da212ff9e"}
Sep 16 12:53:02.642220 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:02.642181    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerID="c8b1eff5d27df46405bdfcaa7be5f00822412ed0453cbe75c39f86184b6344c5" exitCode=0
Sep 16 12:53:02.642679 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:02.642263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb" event={"ID":"5d4f86a1-097a-47d0-8a07-0026141276e7","Type":"ContainerDied","Data":"c8b1eff5d27df46405bdfcaa7be5f00822412ed0453cbe75c39f86184b6344c5"}
Sep 16 12:53:09.668738 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:09.668655    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerID="5e0b83cde8ae35fac76177c832a719c3517abb61d7c26b8752c6240461ed0ca2" exitCode=0
Sep 16 12:53:09.669087 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:09.668735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb" event={"ID":"5d4f86a1-097a-47d0-8a07-0026141276e7","Type":"ContainerDied","Data":"5e0b83cde8ae35fac76177c832a719c3517abb61d7c26b8752c6240461ed0ca2"}
Sep 16 12:53:10.792375 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.792350    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:53:10.874311 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.874283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle\") pod \"5d4f86a1-097a-47d0-8a07-0026141276e7\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") "
Sep 16 12:53:10.874473 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.874318    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util\") pod \"5d4f86a1-097a-47d0-8a07-0026141276e7\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") "
Sep 16 12:53:10.874473 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.874344    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgdpj\" (UniqueName: \"kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj\") pod \"5d4f86a1-097a-47d0-8a07-0026141276e7\" (UID: \"5d4f86a1-097a-47d0-8a07-0026141276e7\") "
Sep 16 12:53:10.874987 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.874958    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle" (OuterVolumeSpecName: "bundle") pod "5d4f86a1-097a-47d0-8a07-0026141276e7" (UID: "5d4f86a1-097a-47d0-8a07-0026141276e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:53:10.876496 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.876466    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj" (OuterVolumeSpecName: "kube-api-access-tgdpj") pod "5d4f86a1-097a-47d0-8a07-0026141276e7" (UID: "5d4f86a1-097a-47d0-8a07-0026141276e7"). InnerVolumeSpecName "kube-api-access-tgdpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:53:10.878264 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.878244    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util" (OuterVolumeSpecName: "util") pod "5d4f86a1-097a-47d0-8a07-0026141276e7" (UID: "5d4f86a1-097a-47d0-8a07-0026141276e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:53:10.975544 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.975480    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgdpj\" (UniqueName: \"kubernetes.io/projected/5d4f86a1-097a-47d0-8a07-0026141276e7-kube-api-access-tgdpj\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:53:10.975544 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.975512    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-bundle\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:53:10.975544 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:10.975521    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d4f86a1-097a-47d0-8a07-0026141276e7-util\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 12:53:11.677914 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:11.677886    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb"
Sep 16 12:53:11.678066 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:11.677886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adtzcb" event={"ID":"5d4f86a1-097a-47d0-8a07-0026141276e7","Type":"ContainerDied","Data":"43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af"}
Sep 16 12:53:11.678066 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:11.678010    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43d111aaa817eae9c87c183bcc142ddb2fbba66139a6d6509a01d6a70bfcc7af"
Sep 16 12:53:14.172964 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:14.172927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:14.260222 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:14.260193    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:20.071571 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.071536    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:20.422391 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422318    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hl778"]
Sep 16 12:53:20.422537 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422525    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="pull"
Sep 16 12:53:20.422586 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422538    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="pull"
Sep 16 12:53:20.422586 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422549    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="extract"
Sep 16 12:53:20.422586 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422554    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="extract"
Sep 16 12:53:20.422586 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422562    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="util"
Sep 16 12:53:20.422586 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422569    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="util"
Sep 16 12:53:20.422729 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.422612    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4f86a1-097a-47d0-8a07-0026141276e7" containerName="extract"
Sep 16 12:53:20.467358 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.467329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hl778"]
Sep 16 12:53:20.467498 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.467443    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.471850 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.471823    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 16 12:53:20.471850 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.471836    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 16 12:53:20.472053 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.471985    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 16 12:53:20.472307 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.472294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-gjmzf\""
Sep 16 12:53:20.473644 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.473408    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 16 12:53:20.473644 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.473429    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 16 12:53:20.532029 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.532000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fld\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-kube-api-access-97fld\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.532167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.532050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.532167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.532113    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e1259221-c5e2-4fc6-b7f6-40adde7053df-cabundle0\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.633162 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.633127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97fld\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-kube-api-access-97fld\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.633338 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.633172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.633338 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.633199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e1259221-c5e2-4fc6-b7f6-40adde7053df-cabundle0\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.633338 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:20.633298    2571 secret.go:281] references non-existent secret key: ca.crt
Sep 16 12:53:20.633338 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:20.633317    2571 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 16 12:53:20.633338 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:20.633324    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-hl778: references non-existent secret key: ca.crt
Sep 16 12:53:20.633588 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:20.633387    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates podName:e1259221-c5e2-4fc6-b7f6-40adde7053df nodeName:}" failed. No retries permitted until 2026-09-16 12:53:21.133370479 +0000 UTC m=+344.188587968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates") pod "keda-operator-579c8958f7-hl778" (UID: "e1259221-c5e2-4fc6-b7f6-40adde7053df") : references non-existent secret key: ca.crt
Sep 16 12:53:20.633755 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.633739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e1259221-c5e2-4fc6-b7f6-40adde7053df-cabundle0\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:20.653048 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:20.653021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fld\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-kube-api-access-97fld\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:21.138120 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.138086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:21.140351 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.140331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e1259221-c5e2-4fc6-b7f6-40adde7053df-certificates\") pod \"keda-operator-579c8958f7-hl778\" (UID: \"e1259221-c5e2-4fc6-b7f6-40adde7053df\") " pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:21.234538 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.234506    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2gwzn"]
Sep 16 12:53:21.258081 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.258056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2gwzn"]
Sep 16 12:53:21.258184 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.258166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.261781 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.261761    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Sep 16 12:53:21.271274 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.271256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:21.339612 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.339593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgksd\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-kube-api-access-mgksd\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.339720 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.339626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.376644 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.376619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:21.392232 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.392176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:21.440488 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.440455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.440616 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.440517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgksd\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-kube-api-access-mgksd\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.440616 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:21.440600    2571 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Sep 16 12:53:21.440685 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:21.440623    2571 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-6c4d864b86-2gwzn: secret "keda-admission-webhooks-certs" not found
Sep 16 12:53:21.440722 ip-10-0-131-158 kubenswrapper[2571]: E0916 12:53:21.440697    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates podName:cb1055e8-7aba-48d6-ad79-733dbaf4da77 nodeName:}" failed. No retries permitted until 2026-09-16 12:53:21.940681014 +0000 UTC m=+344.995898519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates") pod "keda-admission-6c4d864b86-2gwzn" (UID: "cb1055e8-7aba-48d6-ad79-733dbaf4da77") : secret "keda-admission-webhooks-certs" not found
Sep 16 12:53:21.455610 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.455554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgksd\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-kube-api-access-mgksd\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.553613 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.553582    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:21.632633 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.632612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:21.673273 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.673252    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hl778"]
Sep 16 12:53:21.676247 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:53:21.676223    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1259221_c5e2_4fc6_b7f6_40adde7053df.slice/crio-5ee84b12bf357d43bc790caf4edadfd9f79612a3b3b365baa4554a4fabbb5632 WatchSource:0}: Error finding container 5ee84b12bf357d43bc790caf4edadfd9f79612a3b3b365baa4554a4fabbb5632: Status 404 returned error can't find the container with id 5ee84b12bf357d43bc790caf4edadfd9f79612a3b3b365baa4554a4fabbb5632
Sep 16 12:53:21.712097 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.712071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-hl778" event={"ID":"e1259221-c5e2-4fc6-b7f6-40adde7053df","Type":"ContainerStarted","Data":"5ee84b12bf357d43bc790caf4edadfd9f79612a3b3b365baa4554a4fabbb5632"}
Sep 16 12:53:21.944055 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.943977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.946530 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.946510    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/cb1055e8-7aba-48d6-ad79-733dbaf4da77-certificates\") pod \"keda-admission-6c4d864b86-2gwzn\" (UID: \"cb1055e8-7aba-48d6-ad79-733dbaf4da77\") " pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:21.972177 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:21.972147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:22.141401 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.141372    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:22.167071 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.167045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:22.241419 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.241392    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:22.342093 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.342064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:22.440190 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.440163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2gwzn"]
Sep 16 12:53:22.442908 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:53:22.442879    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1055e8_7aba_48d6_ad79_733dbaf4da77.slice/crio-a0f9afac10ea78400069b4664e332f62a24e52a2de6d9e73e2b1b140af7d0699 WatchSource:0}: Error finding container a0f9afac10ea78400069b4664e332f62a24e52a2de6d9e73e2b1b140af7d0699: Status 404 returned error can't find the container with id a0f9afac10ea78400069b4664e332f62a24e52a2de6d9e73e2b1b140af7d0699
Sep 16 12:53:22.717593 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:22.717558    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn" event={"ID":"cb1055e8-7aba-48d6-ad79-733dbaf4da77","Type":"ContainerStarted","Data":"a0f9afac10ea78400069b4664e332f62a24e52a2de6d9e73e2b1b140af7d0699"}
Sep 16 12:53:24.104409 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:24.104348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:24.188776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:24.188736    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:25.729924 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.729889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-hl778" event={"ID":"e1259221-c5e2-4fc6-b7f6-40adde7053df","Type":"ContainerStarted","Data":"e7b73fa79d98fdcac8c7c21447638e3cb6bfc4a0f1a704f2372b6407fbed1262"}
Sep 16 12:53:25.730548 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.729998    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:25.731409 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.731386    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn" event={"ID":"cb1055e8-7aba-48d6-ad79-733dbaf4da77","Type":"ContainerStarted","Data":"b7eb31bf38947a46c3a9b47e0b029b016ea6401bb74f01f5eb4b6abcbe54718c"}
Sep 16 12:53:25.731534 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.731519    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:53:25.750455 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.750414    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-hl778" podStartSLOduration=2.455774363 podStartE2EDuration="5.750401169s" totalImagesPullingTime="3.294626806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:53:25.749686111 +0000 UTC m=+348.804903620" watchObservedRunningTime="2026-09-16 12:53:25.750401169 +0000 UTC m=+348.805618745"
Sep 16 12:53:25.767639 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:25.767596    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn" podStartSLOduration=2.248151498 podStartE2EDuration="4.767585205s" totalImagesPullingTime="2.519433707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:53:25.766959022 +0000 UTC m=+348.822176530" watchObservedRunningTime="2026-09-16 12:53:25.767585205 +0000 UTC m=+348.822802712"
Sep 16 12:53:31.819680 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:31.819575    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:31.893363 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:31.893331    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:46.736725 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:46.736697    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-hl778"
Sep 16 12:53:46.737273 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:53:46.736827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-2gwzn"
Sep 16 12:54:12.778908 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:12.778860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:12.879884 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:12.879838    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:21.620714 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:21.620665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:21.886389 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:21.886302    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:33.838698 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:33.838664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:34.107213 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:34.107122    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.100776 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.100738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.202431 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.202401    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"]
Sep 16 12:54:54.205740 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.205720    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.211326 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.211305    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-zwwr5\""
Sep 16 12:54:54.211326 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.211318    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 16 12:54:54.211488 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.211356    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 16 12:54:54.211488 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.211356    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 16 12:54:54.219836 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.219817    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"]
Sep 16 12:54:54.220465 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.220442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.228719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.228697    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-jfbqz"]
Sep 16 12:54:54.231544 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.231526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.234189 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.234165    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 16 12:54:54.234189 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.234179    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-h4cfl\""
Sep 16 12:54:54.247299 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.247273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-jfbqz"]
Sep 16 12:54:54.251331 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.251269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjw7c\" (UniqueName: \"kubernetes.io/projected/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-kube-api-access-gjw7c\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.251331 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.251314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5gff\" (UniqueName: \"kubernetes.io/projected/df6c899b-3a30-4862-8efb-3091725df44b-kube-api-access-j5gff\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.251489 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.251413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df6c899b-3a30-4862-8efb-3091725df44b-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.251489 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.251451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-data\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.342257 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.342213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.352282 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.352227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df6c899b-3a30-4862-8efb-3091725df44b-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.352282 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.352258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-data\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.352440 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.352308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjw7c\" (UniqueName: \"kubernetes.io/projected/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-kube-api-access-gjw7c\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.352440 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.352387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5gff\" (UniqueName: \"kubernetes.io/projected/df6c899b-3a30-4862-8efb-3091725df44b-kube-api-access-j5gff\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.352677 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.352660    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-data\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.354618 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.354600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df6c899b-3a30-4862-8efb-3091725df44b-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.371817 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.371798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjw7c\" (UniqueName: \"kubernetes.io/projected/20d3d810-94e1-4c53-9fdb-a7f124b5a1d2-kube-api-access-gjw7c\") pod \"seaweedfs-64568bcd49-jfbqz\" (UID: \"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2\") " pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.376046 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.376012    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5gff\" (UniqueName: \"kubernetes.io/projected/df6c899b-3a30-4862-8efb-3091725df44b-kube-api-access-j5gff\") pod \"llmisvc-controller-manager-645f9c8fd6-nt8wn\" (UID: \"df6c899b-3a30-4862-8efb-3091725df44b\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.435609 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.435586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.515666 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.515646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:54.539689 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.539660    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:54.794665 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.794605    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"]
Sep 16 12:54:54.794800 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:54:54.794769    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf6c899b_3a30_4862_8efb_3091725df44b.slice/crio-18dbee6e3619c358a6ce0e0683d62da7f31f95fef8dd7445160183bb43eab53a WatchSource:0}: Error finding container 18dbee6e3619c358a6ce0e0683d62da7f31f95fef8dd7445160183bb43eab53a: Status 404 returned error can't find the container with id 18dbee6e3619c358a6ce0e0683d62da7f31f95fef8dd7445160183bb43eab53a
Sep 16 12:54:54.832746 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.832722    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-jfbqz"]
Sep 16 12:54:54.836613 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:54:54.836588    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d3d810_94e1_4c53_9fdb_a7f124b5a1d2.slice/crio-80d991f9fc8a2e5b03757e97772677378001c7b882b4cf453a6bc69ac72d69db WatchSource:0}: Error finding container 80d991f9fc8a2e5b03757e97772677378001c7b882b4cf453a6bc69ac72d69db: Status 404 returned error can't find the container with id 80d991f9fc8a2e5b03757e97772677378001c7b882b4cf453a6bc69ac72d69db
Sep 16 12:54:54.964005 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:54.963975    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:55.029479 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:55.029448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-jfbqz" event={"ID":"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2","Type":"ContainerStarted","Data":"80d991f9fc8a2e5b03757e97772677378001c7b882b4cf453a6bc69ac72d69db"}
Sep 16 12:54:55.030489 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:55.030471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn" event={"ID":"df6c899b-3a30-4862-8efb-3091725df44b","Type":"ContainerStarted","Data":"18dbee6e3619c358a6ce0e0683d62da7f31f95fef8dd7445160183bb43eab53a"}
Sep 16 12:54:55.062703 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:55.062639    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:59.047374 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.047342    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn" event={"ID":"df6c899b-3a30-4862-8efb-3091725df44b","Type":"ContainerStarted","Data":"b7ec1a789a5aaaa9d89cbf41ca3bf6516a358f02a500dc6080420775691d0ed6"}
Sep 16 12:54:59.047811 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.047403    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:54:59.053297 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.053268    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-jfbqz" event={"ID":"20d3d810-94e1-4c53-9fdb-a7f124b5a1d2","Type":"ContainerStarted","Data":"caa0a8e27eaa1d277ab4c72d5febc441f379293a31543a33937175b1932b066f"}
Sep 16 12:54:59.053455 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.053432    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:54:59.066784 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.066745    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn" podStartSLOduration=1.429604551 podStartE2EDuration="5.066731832s" totalImagesPullingTime="3.637127281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:59.065715412 +0000 UTC m=+442.120932920" watchObservedRunningTime="2026-09-16 12:54:59.066731832 +0000 UTC m=+442.121949366"
Sep 16 12:54:59.083736 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:54:59.083698    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-jfbqz" podStartSLOduration=1.43998637 podStartE2EDuration="5.08368622s" totalImagesPullingTime="3.64369985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:59.082995199 +0000 UTC m=+442.138212717" watchObservedRunningTime="2026-09-16 12:54:59.08368622 +0000 UTC m=+442.138903728"
Sep 16 12:55:05.059311 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:55:05.059285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-jfbqz"
Sep 16 12:55:30.059004 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:55:30.058974    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-nt8wn"
Sep 16 12:56:14.187682 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:14.187632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.285596 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:14.285566    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.593346 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:14.593258    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.737540 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:14.737508    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.825238 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:14.825205    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:15.557048 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:15.557007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:15.643207 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:56:15.643176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:37.391310 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:57:37.391284    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:57:37.394501 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:57:37.394481    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 12:57:49.392207 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:57:49.392154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:49.485478 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:57:49.485448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:56.316725 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:57:56.316682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:00.856847 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:00.856768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.010440 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.010408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.120743 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.120662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.199379 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.199349    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 12:58:01.202581 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.202565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.206708 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.206683    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9sk5b\""
Sep 16 12:58:01.206708 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.206703    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 16 12:58:01.207048 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.207027    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 16 12:58:01.207093 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.207033    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-raw-sklearn-batcher-df47c-kube-rbac-proxy-sar-config\""
Sep 16 12:58:01.207139 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.207057    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 16 12:58:01.207965 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.207945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-raw-sklearn-batcher-df47c-predictor-serving-cert\""
Sep 16 12:58:01.208062 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.207967    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 16 12:58:01.220737 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.220717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 12:58:01.264926 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.264900    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.315178 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.315149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.315471 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.315186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.315471 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.315211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkqm\" (UniqueName: \"kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.315471 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.315264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.315471 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.315331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.365111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.365088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.416102 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416102 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416250 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416250 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkqm\" (UniqueName: \"kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416250 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416539 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416516    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416820 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.416924 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.416808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.418461 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.418443    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.426139 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.426122    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkqm\" (UniqueName: \"kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm\") pod \"isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.512579 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.512553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:01.788572 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.788541    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 12:58:01.791585 ip-10-0-131-158 kubenswrapper[2571]: W0916 12:58:01.791562    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6df9217_d18a_42a2_b49d_f16ccf66cee1.slice/crio-85a396e1148c192ed5987df2332356f98c8cb01e7d08806a4190aef8d770a0f3 WatchSource:0}: Error finding container 85a396e1148c192ed5987df2332356f98c8cb01e7d08806a4190aef8d770a0f3: Status 404 returned error can't find the container with id 85a396e1148c192ed5987df2332356f98c8cb01e7d08806a4190aef8d770a0f3
Sep 16 12:58:01.794025 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:01.794007    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:58:02.670719 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:02.670679    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerStarted","Data":"85a396e1148c192ed5987df2332356f98c8cb01e7d08806a4190aef8d770a0f3"}
Sep 16 12:58:05.683587 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:05.683550    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerStarted","Data":"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"}
Sep 16 12:58:08.695117 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:08.695089    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerID="f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15" exitCode=0
Sep 16 12:58:08.695464 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:08.695138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerDied","Data":"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"}
Sep 16 12:58:22.282439 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:22.282406    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:22.766399 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:22.766368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerStarted","Data":"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"}
Sep 16 12:58:24.776386 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:24.776354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerStarted","Data":"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"}
Sep 16 12:58:26.785631 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:26.785591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerStarted","Data":"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"}
Sep 16 12:58:26.786069 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:26.785819    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:26.786069 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:26.785984    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:26.787120 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:26.787092    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:26.819823 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:26.819748    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podStartSLOduration=1.299808256 podStartE2EDuration="25.819734581s" totalImagesPullingTime="20.787672481s" totalInitContainerRuntime="3.732253844s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:58:01 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:58:26.817288605 +0000 UTC m=+649.872506113" watchObservedRunningTime="2026-09-16 12:58:26.819734581 +0000 UTC m=+649.874952090"
Sep 16 12:58:27.789721 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:27.789684    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:27.789721 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:27.789707    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:27.790883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:27.790841    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:58:28.794274 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:28.794235    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:28.794640 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:28.794554    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:58:33.798532 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:33.798498    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:58:33.799098 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:33.799072    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:33.799341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:33.799315    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:58:43.799849 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:43.799804    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:43.800321 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:43.800253    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:58:46.900843 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:46.900799    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:53.799341 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:53.799306    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:58:53.799793 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:58:53.799779    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:59:03.799445 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:03.799401    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:59:03.799959 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:03.799756    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:59:13.799982 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:13.799941    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:59:13.800412 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:13.800384    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:59:23.799167 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:23.799123    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:59:23.799632 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:23.799522    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:59:31.343102 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:31.343020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:31.425217 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:31.425185    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:33.800035 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:33.800004    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:59:33.800428 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:33.800093    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 12:59:46.182656 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.182626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.278918 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.278890    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 12:59:46.279159 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.279131    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" containerID="cri-o://09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab" gracePeriod=30
Sep 16 12:59:46.279258 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.279154    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" containerID="cri-o://b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79" gracePeriod=30
Sep 16 12:59:46.279258 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.279170    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" containerID="cri-o://d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f" gracePeriod=30
Sep 16 12:59:46.318916 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.318890    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.429690 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.429665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.530916 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:46.530823    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:47.083088 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:47.083057    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerID="d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f" exitCode=2
Sep 16 12:59:47.083284 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:47.083130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerDied","Data":"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"}
Sep 16 12:59:48.794732 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:48.794699    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 12:59:50.825883 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:50.825833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:51.099546 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:51.099476    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerID="09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab" exitCode=0
Sep 16 12:59:51.099546 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:51.099538    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerDied","Data":"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"}
Sep 16 12:59:53.794732 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:53.794687    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 12:59:53.799111 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:53.799086    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 12:59:53.799228 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:53.799206    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:59:58.794233 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:58.794196    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 12:59:58.794671 ip-10-0-131-158 kubenswrapper[2571]: I0916 12:59:58.794349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 13:00:03.795114 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:03.795077    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 13:00:03.799434 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:03.799411    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 13:00:03.799812 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:03.799789    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:00:08.794813 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:08.794780    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 13:00:13.794947 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:13.794899    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused"
Sep 16 13:00:13.799297 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:13.799254    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused"
Sep 16 13:00:13.799449 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:13.799411    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 13:00:13.799643 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:13.799620    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:00:13.799739 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:13.799726    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 13:00:16.415895 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.415875    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 13:00:16.527786 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.527762    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls\") pod \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") "
Sep 16 13:00:16.527941 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.527806    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location\") pod \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") "
Sep 16 13:00:16.527941 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.527849    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config\") pod \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") "
Sep 16 13:00:16.527941 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.527889    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert\") pod \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") "
Sep 16 13:00:16.527941 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.527921    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rkqm\" (UniqueName: \"kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm\") pod \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\" (UID: \"f6df9217-d18a-42a2-b49d-f16ccf66cee1\") "
Sep 16 13:00:16.528242 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.528218    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f6df9217-d18a-42a2-b49d-f16ccf66cee1" (UID: "f6df9217-d18a-42a2-b49d-f16ccf66cee1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:16.528310 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.528266    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f6df9217-d18a-42a2-b49d-f16ccf66cee1" (UID: "f6df9217-d18a-42a2-b49d-f16ccf66cee1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:00:16.528310 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.528274    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f6df9217-d18a-42a2-b49d-f16ccf66cee1" (UID: "f6df9217-d18a-42a2-b49d-f16ccf66cee1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:00:16.529986 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.529967    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm" (OuterVolumeSpecName: "kube-api-access-9rkqm") pod "f6df9217-d18a-42a2-b49d-f16ccf66cee1" (UID: "f6df9217-d18a-42a2-b49d-f16ccf66cee1"). InnerVolumeSpecName "kube-api-access-9rkqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:00:16.530146 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.530125    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f6df9217-d18a-42a2-b49d-f16ccf66cee1" (UID: "f6df9217-d18a-42a2-b49d-f16ccf66cee1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:00:16.628774 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.628745    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6df9217-d18a-42a2-b49d-f16ccf66cee1-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:00:16.628774 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.628769    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kserve-provision-location\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:00:16.628774 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.628778    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:00:16.628982 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.628790    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6df9217-d18a-42a2-b49d-f16ccf66cee1-cabundle-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:00:16.628982 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:16.628804    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rkqm\" (UniqueName: \"kubernetes.io/projected/f6df9217-d18a-42a2-b49d-f16ccf66cee1-kube-api-access-9rkqm\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.191346 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.191313    2571 generic.go:356] "Generic (PLEG): container finished" podID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerID="b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79" exitCode=0
Sep 16 13:00:17.191501 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.191381    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"
Sep 16 13:00:17.191501 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.191396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerDied","Data":"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"}
Sep 16 13:00:17.191501 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.191466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs" event={"ID":"f6df9217-d18a-42a2-b49d-f16ccf66cee1","Type":"ContainerDied","Data":"85a396e1148c192ed5987df2332356f98c8cb01e7d08806a4190aef8d770a0f3"}
Sep 16 13:00:17.191501 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.191497    2571 scope.go:117] "RemoveContainer" containerID="b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"
Sep 16 13:00:17.200086 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.200067    2571 scope.go:117] "RemoveContainer" containerID="d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"
Sep 16 13:00:17.208572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.208556    2571 scope.go:117] "RemoveContainer" containerID="09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"
Sep 16 13:00:17.215176 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.215160    2571 scope.go:117] "RemoveContainer" containerID="f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"
Sep 16 13:00:17.221537 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.221519    2571 scope.go:117] "RemoveContainer" containerID="b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"
Sep 16 13:00:17.221821 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:00:17.221803    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79\": container with ID starting with b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79 not found: ID does not exist" containerID="b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"
Sep 16 13:00:17.221886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.221830    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79"} err="failed to get container status \"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79\": rpc error: code = NotFound desc = could not find container \"b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79\": container with ID starting with b7cf48421f1933b32adfe249c6f2a6dff3dca8a65ec3ddf954389d1e92a3ae79 not found: ID does not exist"
Sep 16 13:00:17.221886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.221846    2571 scope.go:117] "RemoveContainer" containerID="d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"
Sep 16 13:00:17.222092 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:00:17.222076    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f\": container with ID starting with d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f not found: ID does not exist" containerID="d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"
Sep 16 13:00:17.222132 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.222096    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f"} err="failed to get container status \"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f\": rpc error: code = NotFound desc = could not find container \"d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f\": container with ID starting with d5a5223e08f7e08f38da6b2169f785cf3e428caf87bcb6292c7484c5dc66465f not found: ID does not exist"
Sep 16 13:00:17.222132 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.222110    2571 scope.go:117] "RemoveContainer" containerID="09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"
Sep 16 13:00:17.222354 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:00:17.222337    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab\": container with ID starting with 09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab not found: ID does not exist" containerID="09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"
Sep 16 13:00:17.222393 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.222360    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab"} err="failed to get container status \"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab\": rpc error: code = NotFound desc = could not find container \"09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab\": container with ID starting with 09cc4ff78ee641edb3a9bb076b9680b5f1b3ab13241bd8ffe0e96eacdc8e32ab not found: ID does not exist"
Sep 16 13:00:17.222393 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.222375    2571 scope.go:117] "RemoveContainer" containerID="f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"
Sep 16 13:00:17.222623 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:00:17.222607    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15\": container with ID starting with f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15 not found: ID does not exist" containerID="f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"
Sep 16 13:00:17.222677 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.222626    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15"} err="failed to get container status \"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15\": rpc error: code = NotFound desc = could not find container \"f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15\": container with ID starting with f95e2223dd8fa22906c58429293f7b564d68c22dd0cf32d469d79bda2dbdcd15 not found: ID does not exist"
Sep 16 13:00:17.229541 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.229523    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 13:00:17.235357 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.235339    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-df47c-predictor-d8b55d664-kx4qs"]
Sep 16 13:00:17.432171 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:17.432144    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" path="/var/lib/kubelet/pods/f6df9217-d18a-42a2-b49d-f16ccf66cee1/volumes"
Sep 16 13:00:44.596593 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:00:44.596559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:21.071561 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:21.071519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.180942 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.180895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.267091 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267061    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:01:26.267318 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267306    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267319    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267331    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="storage-initializer"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267336    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="storage-initializer"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267344    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267350    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container"
Sep 16 13:01:26.267368 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267366    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent"
Sep 16 13:01:26.267563 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267374    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent"
Sep 16 13:01:26.267563 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267416    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="agent"
Sep 16 13:01:26.267563 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267424    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kube-rbac-proxy"
Sep 16 13:01:26.267563 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.267433    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6df9217-d18a-42a2-b49d-f16ccf66cee1" containerName="kserve-container"
Sep 16 13:01:26.270240 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.270217    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.270365 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.270330    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:01:26.272707 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.272681    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-ec80e-kube-rbac-proxy-sar-config\""
Sep 16 13:01:26.273337 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.273319    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-ec80e-serving-cert\""
Sep 16 13:01:26.273659 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.273641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.273750 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.273706    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 16 13:01:26.274033 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.274013    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9sk5b\""
Sep 16 13:01:26.276750 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.276731    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 16 13:01:26.277311 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.277294    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 16 13:01:26.277794 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.277600    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Sep 16 13:01:26.278216 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.278199    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-predictor-serving-cert\""
Sep 16 13:01:26.279096 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.279067    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 16 13:01:26.280691 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.280672    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:01:26.299675 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.299651    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:01:26.305324 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.305298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.386764 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.386912 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386768    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.386912 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.386912 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.386912 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386907    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.387082 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjg27\" (UniqueName: \"kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.387082 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.386955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.400750 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.400720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.487633 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.487565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.487633 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.487605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjg27\" (UniqueName: \"kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.487633 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.487623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.487920 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.487897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488035 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.487940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.488105 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488158 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488220 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:01:26.488202    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-stop-predictor-serving-cert: secret "isvc-canary-stop-predictor-serving-cert" not found
Sep 16 13:01:26.488274 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:01:26.488264    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls podName:f4d17844-eae9-4c8e-ab43-b216589f6a22 nodeName:}" failed. No retries permitted until 2026-09-16 13:01:26.988244662 +0000 UTC m=+830.043462151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls") pod "isvc-canary-stop-predictor-67d6bcd4b5-jggcf" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22") : secret "isvc-canary-stop-predictor-serving-cert" not found
Sep 16 13:01:26.488339 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488391 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488644 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488626    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.488712 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.488674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.490079 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.490058    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls\") pod \"model-chainer-raw-ec80e-757688698c-dfm2j\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") " pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.498019 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.498002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjg27\" (UniqueName: \"kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.536681 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.536654    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.581824 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.581804    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:26.655975 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.655946    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:26.855748 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.855730    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:01:26.857727 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:01:26.857701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24c37be_0f9c_49ed_91f3_a8f3c6f3810e.slice/crio-93df3f9274e410c3dfbba7619a7b6166ec17039b3821bb8434d21cb6dbf2a9ee WatchSource:0}: Error finding container 93df3f9274e410c3dfbba7619a7b6166ec17039b3821bb8434d21cb6dbf2a9ee: Status 404 returned error can't find the container with id 93df3f9274e410c3dfbba7619a7b6166ec17039b3821bb8434d21cb6dbf2a9ee
Sep 16 13:01:26.991680 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.991654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:26.993955 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:26.993938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") pod \"isvc-canary-stop-predictor-67d6bcd4b5-jggcf\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:27.187853 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:27.187825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:27.426565 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:27.426537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" event={"ID":"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e","Type":"ContainerStarted","Data":"93df3f9274e410c3dfbba7619a7b6166ec17039b3821bb8434d21cb6dbf2a9ee"}
Sep 16 13:01:27.461287 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:27.461264    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:01:27.462138 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:01:27.462111    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d17844_eae9_4c8e_ab43_b216589f6a22.slice/crio-07aed8937cfbab44305d6915031703dc956b0f9524e2c897da3236a2b66afb3e WatchSource:0}: Error finding container 07aed8937cfbab44305d6915031703dc956b0f9524e2c897da3236a2b66afb3e: Status 404 returned error can't find the container with id 07aed8937cfbab44305d6915031703dc956b0f9524e2c897da3236a2b66afb3e
Sep 16 13:01:28.431911 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:28.431859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerStarted","Data":"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"}
Sep 16 13:01:28.432336 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:28.431944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerStarted","Data":"07aed8937cfbab44305d6915031703dc956b0f9524e2c897da3236a2b66afb3e"}
Sep 16 13:01:29.436689 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:29.436652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" event={"ID":"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e","Type":"ContainerStarted","Data":"9703d8b17697ecddde1f1243979049c560df5b5f4a4ae35d240b102a0f5094c4"}
Sep 16 13:01:29.456780 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:29.456733    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podStartSLOduration=1.10136587 podStartE2EDuration="3.456718984s" totalImagesPullingTime="2.355353114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:29.456126646 +0000 UTC m=+832.511344153" watchObservedRunningTime="2026-09-16 13:01:29.456718984 +0000 UTC m=+832.511936491"
Sep 16 13:01:30.441056 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:30.441022    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:01:32.449305 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:32.449270    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerID="2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a" exitCode=0
Sep 16 13:01:32.449704 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:32.449347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerDied","Data":"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"}
Sep 16 13:01:33.455413 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.455379    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerStarted","Data":"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"}
Sep 16 13:01:33.455826 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.455438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerStarted","Data":"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"}
Sep 16 13:01:33.455826 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.455762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:33.455826 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.455812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:33.457081 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.457056    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:01:33.493412 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:33.493359    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podStartSLOduration=3.380801326 podStartE2EDuration="7.493343889s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.112542563s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:33.491196422 +0000 UTC m=+836.546413931" watchObservedRunningTime="2026-09-16 13:01:33.493343889 +0000 UTC m=+836.548561396"
Sep 16 13:01:34.459456 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:34.459415    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:01:36.336789 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.336758    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:01:36.337231 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.336961    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" containerID="cri-o://9703d8b17697ecddde1f1243979049c560df5b5f4a4ae35d240b102a0f5094c4" gracePeriod=30
Sep 16 13:01:36.342034 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.342006    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:01:36.387895 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.387842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.572630 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.572594    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.704399 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.704354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.877173 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:36.877142    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:37.105750 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:37.105661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:37.437045 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:37.437015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:39.463968 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:39.463944    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:01:39.464389 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:39.464362    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:01:41.341458 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:41.341420    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:01:46.340912 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:46.340853    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:01:49.464370 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:49.464330    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:01:51.341236 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:51.341200    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:01:56.341110 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:56.341077    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:01:59.464632 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:01:59.464591    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:02:01.341161 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:01.341122    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:02:06.341108 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:06.341073    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:02:06.569289 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:06.569258    2571 generic.go:356] "Generic (PLEG): container finished" podID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerID="9703d8b17697ecddde1f1243979049c560df5b5f4a4ae35d240b102a0f5094c4" exitCode=0
Sep 16 13:02:06.569415 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:06.569321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" event={"ID":"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e","Type":"ContainerDied","Data":"9703d8b17697ecddde1f1243979049c560df5b5f4a4ae35d240b102a0f5094c4"}
Sep 16 13:02:06.986252 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:06.986230    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:02:07.083407 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.083376    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle\") pod \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") "
Sep 16 13:02:07.083556 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.083441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls\") pod \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\" (UID: \"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e\") "
Sep 16 13:02:07.083735 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.083709    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" (UID: "f24c37be-0f9c-49ed-91f3-a8f3c6f3810e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:02:07.085386 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.085362    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" (UID: "f24c37be-0f9c-49ed-91f3-a8f3c6f3810e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:02:07.184839 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.184819    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-openshift-service-ca-bundle\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:02:07.184839 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.184840    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:02:07.574008 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.573975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j" event={"ID":"f24c37be-0f9c-49ed-91f3-a8f3c6f3810e","Type":"ContainerDied","Data":"93df3f9274e410c3dfbba7619a7b6166ec17039b3821bb8434d21cb6dbf2a9ee"}
Sep 16 13:02:07.574415 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.574009    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"
Sep 16 13:02:07.574415 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.574031    2571 scope.go:117] "RemoveContainer" containerID="9703d8b17697ecddde1f1243979049c560df5b5f4a4ae35d240b102a0f5094c4"
Sep 16 13:02:07.591192 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.591167    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:02:07.594370 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:07.594352    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-ec80e-757688698c-dfm2j"]
Sep 16 13:02:09.431288 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:09.431251    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" path="/var/lib/kubelet/pods/f24c37be-0f9c-49ed-91f3-a8f3c6f3810e/volumes"
Sep 16 13:02:09.465055 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:09.465021    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:02:19.465054 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:19.465015    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:02:29.464683 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:29.464647    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:02:37.415271 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:37.415190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:02:37.416664 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:37.416642    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:02:39.465110 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:39.465077    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:02:49.465063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:49.465033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:02:56.203583 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.203548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:56.224040 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.224011    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:02:56.224271 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.224232    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" containerID="cri-o://76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346" gracePeriod=30
Sep 16 13:02:56.224338 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.224269    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kube-rbac-proxy" containerID="cri-o://2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d" gracePeriod=30
Sep 16 13:02:56.270598 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.270565    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:56.743155 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.743126    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerID="2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d" exitCode=2
Sep 16 13:02:56.743336 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:56.743197    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerDied","Data":"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"}
Sep 16 13:02:59.460544 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:59.460505    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.20:8643/healthz\": dial tcp 10.132.0.20:8643: connect: connection refused"
Sep 16 13:02:59.464837 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:02:59.464816    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.20:8080: connect: connection refused"
Sep 16 13:03:00.458751 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.458727    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:03:00.623245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623175    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") pod \"f4d17844-eae9-4c8e-ab43-b216589f6a22\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") "
Sep 16 13:03:00.623245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623224    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert\") pod \"f4d17844-eae9-4c8e-ab43-b216589f6a22\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") "
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623259    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location\") pod \"f4d17844-eae9-4c8e-ab43-b216589f6a22\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") "
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjg27\" (UniqueName: \"kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27\") pod \"f4d17844-eae9-4c8e-ab43-b216589f6a22\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") "
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623309    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config\") pod \"f4d17844-eae9-4c8e-ab43-b216589f6a22\" (UID: \"f4d17844-eae9-4c8e-ab43-b216589f6a22\") "
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623608    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f4d17844-eae9-4c8e-ab43-b216589f6a22" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f4d17844-eae9-4c8e-ab43-b216589f6a22" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:03:00.623791 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.623687    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f4d17844-eae9-4c8e-ab43-b216589f6a22" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:03:00.625266 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.625247    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f4d17844-eae9-4c8e-ab43-b216589f6a22" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:03:00.625381 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.625360    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27" (OuterVolumeSpecName: "kube-api-access-xjg27") pod "f4d17844-eae9-4c8e-ab43-b216589f6a22" (UID: "f4d17844-eae9-4c8e-ab43-b216589f6a22"). InnerVolumeSpecName "kube-api-access-xjg27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:03:00.724159 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.724127    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjg27\" (UniqueName: \"kubernetes.io/projected/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-api-access-xjg27\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:00.724159 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.724152    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:00.724159 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.724162    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4d17844-eae9-4c8e-ab43-b216589f6a22-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:00.724353 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.724171    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4d17844-eae9-4c8e-ab43-b216589f6a22-cabundle-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:00.724353 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.724179    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4d17844-eae9-4c8e-ab43-b216589f6a22-kserve-provision-location\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:00.757617 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.757588    2571 generic.go:356] "Generic (PLEG): container finished" podID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerID="76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346" exitCode=0
Sep 16 13:03:00.757738 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.757647    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"
Sep 16 13:03:00.757738 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.757660    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerDied","Data":"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"}
Sep 16 13:03:00.757738 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.757723    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf" event={"ID":"f4d17844-eae9-4c8e-ab43-b216589f6a22","Type":"ContainerDied","Data":"07aed8937cfbab44305d6915031703dc956b0f9524e2c897da3236a2b66afb3e"}
Sep 16 13:03:00.757844 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.757760    2571 scope.go:117] "RemoveContainer" containerID="2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"
Sep 16 13:03:00.765922 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.765904    2571 scope.go:117] "RemoveContainer" containerID="76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"
Sep 16 13:03:00.772480 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.772465    2571 scope.go:117] "RemoveContainer" containerID="2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"
Sep 16 13:03:00.779303 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.779274    2571 scope.go:117] "RemoveContainer" containerID="2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"
Sep 16 13:03:00.779760 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:00.779592    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d\": container with ID starting with 2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d not found: ID does not exist" containerID="2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"
Sep 16 13:03:00.779760 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.779634    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d"} err="failed to get container status \"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d\": rpc error: code = NotFound desc = could not find container \"2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d\": container with ID starting with 2d07d359cfa847162e122d2fbcb8c9bbda824568b132627b2558cafcc2429a2d not found: ID does not exist"
Sep 16 13:03:00.779760 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.779659    2571 scope.go:117] "RemoveContainer" containerID="76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"
Sep 16 13:03:00.779993 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:00.779921    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346\": container with ID starting with 76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346 not found: ID does not exist" containerID="76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"
Sep 16 13:03:00.779993 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.779944    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346"} err="failed to get container status \"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346\": rpc error: code = NotFound desc = could not find container \"76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346\": container with ID starting with 76e53da46184d8f652edb94e5c3dd1cb758d40a2f942cebfd0a20616d8e30346 not found: ID does not exist"
Sep 16 13:03:00.779993 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.779962    2571 scope.go:117] "RemoveContainer" containerID="2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"
Sep 16 13:03:00.780211 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:00.780191    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a\": container with ID starting with 2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a not found: ID does not exist" containerID="2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"
Sep 16 13:03:00.780268 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.780214    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a"} err="failed to get container status \"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a\": rpc error: code = NotFound desc = could not find container \"2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a\": container with ID starting with 2bc3cd325d9695adaf01dd2dcbe47f3cd0b9562c97758fb25136c040d0b9483a not found: ID does not exist"
Sep 16 13:03:00.781454 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.781433    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:03:00.784326 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:00.784305    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-67d6bcd4b5-jggcf"]
Sep 16 13:03:01.431697 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:01.431665    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" path="/var/lib/kubelet/pods/f4d17844-eae9-4c8e-ab43-b216589f6a22/volumes"
Sep 16 13:03:06.490044 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:06.490012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:06.618262 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:06.618233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:16.641706 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641677    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641954    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="storage-initializer"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641966    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="storage-initializer"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641976    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641981    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641987    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kube-rbac-proxy"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.641993    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kube-rbac-proxy"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.642007    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.642012    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.642050    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kserve-container"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.642057    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d17844-eae9-4c8e-ab43-b216589f6a22" containerName="kube-rbac-proxy"
Sep 16 13:03:16.642063 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.642065    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f24c37be-0f9c-49ed-91f3-a8f3c6f3810e" containerName="model-chainer-raw-ec80e"
Sep 16 13:03:16.644798 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.644783    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:16.647932 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.647911    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-5b43d-kube-rbac-proxy-sar-config\""
Sep 16 13:03:16.649137 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.649121    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-5b43d-serving-cert\""
Sep 16 13:03:16.649248 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.649139    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 16 13:03:16.649248 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.649165    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9sk5b\""
Sep 16 13:03:16.656196 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.656178    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:16.659326 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.659304    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:16.730929 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.730906    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:16.731016 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.730946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:16.832114 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.832089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:16.832250 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.832156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:16.832250 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:16.832224    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-serving-cert: secret "model-chainer-raw-hpa-5b43d-serving-cert" not found
Sep 16 13:03:16.832358 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:16.832287    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls podName:b1dbe45f-cfbb-4763-838e-bc996404835d nodeName:}" failed. No retries permitted until 2026-09-16 13:03:17.332271899 +0000 UTC m=+940.387489384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls") pod "model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" (UID: "b1dbe45f-cfbb-4763-838e-bc996404835d") : secret "model-chainer-raw-hpa-5b43d-serving-cert" not found
Sep 16 13:03:16.832751 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:16.832728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:17.230223 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:17.230185    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:17.335566 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:17.335542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:17.337774 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:17.337757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") pod \"model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:17.553995 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:17.553927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:17.823420 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:17.823395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:17.825453 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:03:17.825424    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1dbe45f_cfbb_4763_838e_bc996404835d.slice/crio-c720c1c431daa8219f53a094d47bea56b6c4b6e113e4f51bb9c86185768dd64a WatchSource:0}: Error finding container c720c1c431daa8219f53a094d47bea56b6c4b6e113e4f51bb9c86185768dd64a: Status 404 returned error can't find the container with id c720c1c431daa8219f53a094d47bea56b6c4b6e113e4f51bb9c86185768dd64a
Sep 16 13:03:18.822685 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:18.822649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" event={"ID":"b1dbe45f-cfbb-4763-838e-bc996404835d","Type":"ContainerStarted","Data":"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"}
Sep 16 13:03:18.822893 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:18.822697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" event={"ID":"b1dbe45f-cfbb-4763-838e-bc996404835d","Type":"ContainerStarted","Data":"c720c1c431daa8219f53a094d47bea56b6c4b6e113e4f51bb9c86185768dd64a"}
Sep 16 13:03:18.822893 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:18.822750    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:18.848755 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:18.848715    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podStartSLOduration=2.848701497 podStartE2EDuration="2.848701497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:03:18.848566803 +0000 UTC m=+941.903784311" watchObservedRunningTime="2026-09-16 13:03:18.848701497 +0000 UTC m=+941.903919005"
Sep 16 13:03:24.832195 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:24.832167    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:26.771523 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:26.771495    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:26.771952 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:26.771670    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" containerID="cri-o://3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb" gracePeriod=30
Sep 16 13:03:26.808952 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:26.808925    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:28.584602 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:28.584564    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:29.830408 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:29.830368    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:34.801495 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:34.801457    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:34.830736 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:34.830707    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:39.830478 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:39.830442    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:39.830897 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:39.830564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:44.830391 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:44.830352    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:46.959445 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:46.959414    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:46.994447 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:46.994425    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:03:46.998763 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:46.998748    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.001201 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.001183    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-6a607-kube-rbac-proxy-sar-config\""
Sep 16 13:03:47.001551 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.001531    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 16 13:03:47.001700 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.001677    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-6a607-predictor-serving-cert\""
Sep 16 13:03:47.001809 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.001791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 16 13:03:47.001944 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.001919    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 16 13:03:47.014000 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.013981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:03:47.038564 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.038544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65tkd\" (UniqueName: \"kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.038660 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.038574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.038660 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.038604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.038734 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.038671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.038734 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.038718    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.134019 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.133989    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:47.139936 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.139915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.139994 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.139961    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.139994 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.139982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.140061 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.140009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65tkd\" (UniqueName: \"kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.140061 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.140029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.140340 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.140318    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.140590 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.140565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.140682 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.140657    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.142418 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.142401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.149053 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.149033    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65tkd\" (UniqueName: \"kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd\") pod \"isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") " pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.307797 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.307733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:47.577042 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.577015    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:03:47.578532 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:03:47.578507    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7853a8f9_f413_4557_83e9_7737f994201a.slice/crio-2b4171526a5e4cab4584f1b1ebeaf7e657c373ff36b7085997b048512dbc60ba WatchSource:0}: Error finding container 2b4171526a5e4cab4584f1b1ebeaf7e657c373ff36b7085997b048512dbc60ba: Status 404 returned error can't find the container with id 2b4171526a5e4cab4584f1b1ebeaf7e657c373ff36b7085997b048512dbc60ba
Sep 16 13:03:47.924986 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.924953    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerStarted","Data":"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"}
Sep 16 13:03:47.925143 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:47.925013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerStarted","Data":"2b4171526a5e4cab4584f1b1ebeaf7e657c373ff36b7085997b048512dbc60ba"}
Sep 16 13:03:49.830976 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:49.830935    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:51.941600 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:51.941571    2571 generic.go:356] "Generic (PLEG): container finished" podID="7853a8f9-f413-4557-83e9-7737f994201a" containerID="bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27" exitCode=0
Sep 16 13:03:51.941975 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:51.941643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerDied","Data":"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"}
Sep 16 13:03:52.947925 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.947892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerStarted","Data":"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"}
Sep 16 13:03:52.948320 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.947980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerStarted","Data":"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"}
Sep 16 13:03:52.948320 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.948006    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerStarted","Data":"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"}
Sep 16 13:03:52.948320 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.948289    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:52.948484 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.948468    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:52.949617 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.949596    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:03:52.970407 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:52.970365    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podStartSLOduration=3.00786601 podStartE2EDuration="6.970352243s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.962486233s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:03:52.968461315 +0000 UTC m=+976.023678827" watchObservedRunningTime="2026-09-16 13:03:52.970352243 +0000 UTC m=+976.025569752"
Sep 16 13:03:53.951189 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:53.951162    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:53.951600 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:53.951328    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:03:53.952291 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:53.952260    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:54.830404 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:54.830365    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:54.955173 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:54.955138    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:03:54.955645 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:54.955623    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:03:56.909226 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.909203    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:56.962746 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.962712    2571 generic.go:356] "Generic (PLEG): container finished" podID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerID="3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb" exitCode=0
Sep 16 13:03:56.962904 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.962757    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"
Sep 16 13:03:56.962904 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.962769    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" event={"ID":"b1dbe45f-cfbb-4763-838e-bc996404835d","Type":"ContainerDied","Data":"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"}
Sep 16 13:03:56.962904 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.962820    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7" event={"ID":"b1dbe45f-cfbb-4763-838e-bc996404835d","Type":"ContainerDied","Data":"c720c1c431daa8219f53a094d47bea56b6c4b6e113e4f51bb9c86185768dd64a"}
Sep 16 13:03:56.962904 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.962851    2571 scope.go:117] "RemoveContainer" containerID="3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"
Sep 16 13:03:56.970379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.970360    2571 scope.go:117] "RemoveContainer" containerID="3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"
Sep 16 13:03:56.970635 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:03:56.970616    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb\": container with ID starting with 3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb not found: ID does not exist" containerID="3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"
Sep 16 13:03:56.970685 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:56.970644    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb"} err="failed to get container status \"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb\": rpc error: code = NotFound desc = could not find container \"3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb\": container with ID starting with 3b345f46238bb13114f557bf56c3d79cb079e9dbb85679bbfa1cd80818df92fb not found: ID does not exist"
Sep 16 13:03:57.013027 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.013004    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle\") pod \"b1dbe45f-cfbb-4763-838e-bc996404835d\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") "
Sep 16 13:03:57.013103 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.013057    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") pod \"b1dbe45f-cfbb-4763-838e-bc996404835d\" (UID: \"b1dbe45f-cfbb-4763-838e-bc996404835d\") "
Sep 16 13:03:57.013313 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.013292    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b1dbe45f-cfbb-4763-838e-bc996404835d" (UID: "b1dbe45f-cfbb-4763-838e-bc996404835d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:03:57.014954 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.014935    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b1dbe45f-cfbb-4763-838e-bc996404835d" (UID: "b1dbe45f-cfbb-4763-838e-bc996404835d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:03:57.114278 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.114216    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1dbe45f-cfbb-4763-838e-bc996404835d-openshift-service-ca-bundle\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:57.114278 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.114247    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b1dbe45f-cfbb-4763-838e-bc996404835d-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:03:57.283641 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.283603    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:57.285565 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.285544    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-5b43d-6f676bb698-d5hg7"]
Sep 16 13:03:57.431909 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:57.431860    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" path="/var/lib/kubelet/pods/b1dbe45f-cfbb-4763-838e-bc996404835d/volumes"
Sep 16 13:03:59.960917 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:59.960889    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:03:59.961598 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:59.961572    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:03:59.961936 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:03:59.961910    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:09.962478 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:09.962437    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:09.962967 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:09.962859    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:19.961654 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:19.961617    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:19.962177 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:19.962154    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:20.021667 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:20.021634    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:29.962500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:29.962452    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:29.963025 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:29.962824    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:39.961484 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:39.961440    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:39.961886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:39.961851    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:49.962153 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:49.962107    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:49.962642 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:49.962599    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:04:51.649672 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:51.649641    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:52.421156 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:52.421120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:59.962202 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:59.962156    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:04:59.962693 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:04:59.962583    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:05:02.428071 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:02.428037    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:02.428508 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:02.428368    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:04.484595 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:04.484562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:04.554844 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:04.554815    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:11.725159 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:11.725127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:11.780644 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:11.780609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:12.193241 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.193214    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:05:12.193521 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.193492    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" containerID="cri-o://77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad" gracePeriod=30
Sep 16 13:05:12.193668 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.193541    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" containerID="cri-o://533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133" gracePeriod=30
Sep 16 13:05:12.193668 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.193473    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" containerID="cri-o://e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d" gracePeriod=30
Sep 16 13:05:12.247297 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.247271    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:12.324891 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.324850    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:12.427842 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.427805    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:05:12.428183 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.428149    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:05:12.606844 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:12.606764    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:13.233646 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:13.233619    2571 generic.go:356] "Generic (PLEG): container finished" podID="7853a8f9-f413-4557-83e9-7737f994201a" containerID="533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133" exitCode=2
Sep 16 13:05:13.234033 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:13.233694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerDied","Data":"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"}
Sep 16 13:05:14.955763 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:14.955722    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:16.248073 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:16.248044    2571 generic.go:356] "Generic (PLEG): container finished" podID="7853a8f9-f413-4557-83e9-7737f994201a" containerID="e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d" exitCode=0
Sep 16 13:05:16.248391 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:16.248118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerDied","Data":"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"}
Sep 16 13:05:16.880550 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:16.880522    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:17.068404 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:17.068370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:19.956087 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:19.956053    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:22.428493 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:22.428452    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:05:22.428891 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:22.428796    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:05:24.955673 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:24.955632    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:24.956084 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:24.955774    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:26.916011 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:26.915983    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:29.956206 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:29.956166    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:32.104031 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.104001    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:32.355484 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.355407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:32.428540 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.428491    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Sep 16 13:05:32.428702 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.428645    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:32.428838 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.428820    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:05:32.428934 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:32.428920    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:34.955958 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:34.955920    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:39.956184 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:39.956142    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Sep 16 13:05:42.334117 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.334093    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:42.338571 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.338544    2571 generic.go:356] "Generic (PLEG): container finished" podID="7853a8f9-f413-4557-83e9-7737f994201a" containerID="77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad" exitCode=137
Sep 16 13:05:42.338677 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.338591    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"
Sep 16 13:05:42.338677 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.338608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerDied","Data":"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"}
Sep 16 13:05:42.338677 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.338664    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh" event={"ID":"7853a8f9-f413-4557-83e9-7737f994201a","Type":"ContainerDied","Data":"2b4171526a5e4cab4584f1b1ebeaf7e657c373ff36b7085997b048512dbc60ba"}
Sep 16 13:05:42.338924 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.338695    2571 scope.go:117] "RemoveContainer" containerID="77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"
Sep 16 13:05:42.345846 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.345830    2571 scope.go:117] "RemoveContainer" containerID="533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"
Sep 16 13:05:42.352431 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.352415    2571 scope.go:117] "RemoveContainer" containerID="e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"
Sep 16 13:05:42.360180 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.360156    2571 scope.go:117] "RemoveContainer" containerID="bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"
Sep 16 13:05:42.368077 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368060    2571 scope.go:117] "RemoveContainer" containerID="77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"
Sep 16 13:05:42.368323 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:05:42.368295    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad\": container with ID starting with 77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad not found: ID does not exist" containerID="77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"
Sep 16 13:05:42.368376 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368322    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad"} err="failed to get container status \"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad\": rpc error: code = NotFound desc = could not find container \"77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad\": container with ID starting with 77eae28240362f06fd63b09d68fda60808cfe1fe570121c31271d8434f0444ad not found: ID does not exist"
Sep 16 13:05:42.368376 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368339    2571 scope.go:117] "RemoveContainer" containerID="533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"
Sep 16 13:05:42.368622 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:05:42.368606    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133\": container with ID starting with 533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133 not found: ID does not exist" containerID="533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"
Sep 16 13:05:42.368673 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368623    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133"} err="failed to get container status \"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133\": rpc error: code = NotFound desc = could not find container \"533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133\": container with ID starting with 533a384ca14127adee2f59ccbb616cc78aff92c94060eadc452e0c8ccba8f133 not found: ID does not exist"
Sep 16 13:05:42.368673 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368635    2571 scope.go:117] "RemoveContainer" containerID="e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"
Sep 16 13:05:42.368898 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:05:42.368859    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d\": container with ID starting with e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d not found: ID does not exist" containerID="e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"
Sep 16 13:05:42.368962 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368903    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d"} err="failed to get container status \"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d\": rpc error: code = NotFound desc = could not find container \"e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d\": container with ID starting with e7fa04a833f4f8e12fc9a263e7ac0b1e428d6973ee77fbd8e9effd2082f6b64d not found: ID does not exist"
Sep 16 13:05:42.368962 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.368916    2571 scope.go:117] "RemoveContainer" containerID="bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"
Sep 16 13:05:42.369156 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:05:42.369140    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27\": container with ID starting with bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27 not found: ID does not exist" containerID="bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"
Sep 16 13:05:42.369205 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.369160    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27"} err="failed to get container status \"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27\": rpc error: code = NotFound desc = could not find container \"bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27\": container with ID starting with bb3cf71d5560031d1e666399674b9cd63c3c59bcf97ed89b9b877c54a6a25d27 not found: ID does not exist"
Sep 16 13:05:42.433959 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.433934    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config\") pod \"7853a8f9-f413-4557-83e9-7737f994201a\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") "
Sep 16 13:05:42.434066 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.433977    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert\") pod \"7853a8f9-f413-4557-83e9-7737f994201a\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") "
Sep 16 13:05:42.434066 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434029    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls\") pod \"7853a8f9-f413-4557-83e9-7737f994201a\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") "
Sep 16 13:05:42.434066 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434060    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65tkd\" (UniqueName: \"kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd\") pod \"7853a8f9-f413-4557-83e9-7737f994201a\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") "
Sep 16 13:05:42.434533 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434179    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location\") pod \"7853a8f9-f413-4557-83e9-7737f994201a\" (UID: \"7853a8f9-f413-4557-83e9-7737f994201a\") "
Sep 16 13:05:42.434533 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434319    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7853a8f9-f413-4557-83e9-7737f994201a" (UID: "7853a8f9-f413-4557-83e9-7737f994201a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:05:42.434533 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434391    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:05:42.434533 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434394    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "7853a8f9-f413-4557-83e9-7737f994201a" (UID: "7853a8f9-f413-4557-83e9-7737f994201a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:05:42.434533 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.434488    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "7853a8f9-f413-4557-83e9-7737f994201a" (UID: "7853a8f9-f413-4557-83e9-7737f994201a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:05:42.436002 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.435983    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd" (OuterVolumeSpecName: "kube-api-access-65tkd") pod "7853a8f9-f413-4557-83e9-7737f994201a" (UID: "7853a8f9-f413-4557-83e9-7737f994201a"). InnerVolumeSpecName "kube-api-access-65tkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:05:42.436110 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.436096    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7853a8f9-f413-4557-83e9-7737f994201a" (UID: "7853a8f9-f413-4557-83e9-7737f994201a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:05:42.535568 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.535520    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/7853a8f9-f413-4557-83e9-7737f994201a-cabundle-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:05:42.535568 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.535539    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7853a8f9-f413-4557-83e9-7737f994201a-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:05:42.535568 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.535548    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65tkd\" (UniqueName: \"kubernetes.io/projected/7853a8f9-f413-4557-83e9-7737f994201a-kube-api-access-65tkd\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:05:42.535568 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.535557    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7853a8f9-f413-4557-83e9-7737f994201a-kserve-provision-location\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:05:42.660322 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.660297    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:05:42.665369 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:42.665352    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-6a607-predictor-54d644fd9-6jgbh"]
Sep 16 13:05:43.431824 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:05:43.431791    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7853a8f9-f413-4557-83e9-7737f994201a" path="/var/lib/kubelet/pods/7853a8f9-f413-4557-83e9-7737f994201a/volumes"
Sep 16 13:07:02.276050 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:02.275968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:07.360300 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:07.360269    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:07.563830 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:07.563794    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:37.440690 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:37.440665    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:07:37.441431 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:37.441413    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:07:42.389034 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:42.388999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.529362 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.529324    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.603585 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.603557    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.639961 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.639934    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:07:47.640174 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640162    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640176    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640187    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="storage-initializer"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640193    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="storage-initializer"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640203    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640208    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640214    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy"
Sep 16 13:07:47.640222 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640219    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640225    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640230    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640275    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kube-rbac-proxy"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640283    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1dbe45f-cfbb-4763-838e-bc996404835d" containerName="model-chainer-raw-hpa-5b43d"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640289    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="kserve-container"
Sep 16 13:07:47.640429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.640295    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7853a8f9-f413-4557-83e9-7737f994201a" containerName="agent"
Sep 16 13:07:47.643162 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.643148    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.645491 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.645459    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9sk5b\""
Sep 16 13:07:47.645711 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.645680    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 16 13:07:47.645817 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.645737    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 16 13:07:47.646715 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.646702    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 16 13:07:47.646804 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.646742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-predictor-serving-cert\""
Sep 16 13:07:47.646804 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.646749    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Sep 16 13:07:47.646804 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.646769    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 16 13:07:47.652119 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.652102    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:07:47.660750 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.660728    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8mv\" (UniqueName: \"kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.660840 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.660772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.660902 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.660876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.660950 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.660920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.660950 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.660942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.745254 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.745226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.761396 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.761500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.761500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8mv\" (UniqueName: \"kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.761500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.761663 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:07:47.761512    2571 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-create-predictor-serving-cert: secret "isvc-canary-create-predictor-serving-cert" not found
Sep 16 13:07:47.761663 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.761663 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:07:47.761581    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls podName:4cec1e1c-3fc2-4839-a0a3-118ca3822b42 nodeName:}" failed. No retries permitted until 2026-09-16 13:07:48.261562928 +0000 UTC m=+1211.316780431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls") pod "isvc-canary-create-predictor-8cb968449-mh7rp" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42") : secret "isvc-canary-create-predictor-serving-cert" not found
Sep 16 13:07:47.761827 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.761814    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.762074 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.762050    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.762172 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.762153    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:47.771383 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:47.771364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8mv\" (UniqueName: \"kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:48.163432 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:48.163395    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:48.265333 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:48.265299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:48.267660 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:48.267639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") pod \"isvc-canary-create-predictor-8cb968449-mh7rp\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:48.554099 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:48.554068    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:48.825276 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:48.825252    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:07:48.827470 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:07:48.827445    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cec1e1c_3fc2_4839_a0a3_118ca3822b42.slice/crio-abdeb5c7ab6a988d1c84e084b501f37fdb60ed84594b0d7409175cefafa47ad0 WatchSource:0}: Error finding container abdeb5c7ab6a988d1c84e084b501f37fdb60ed84594b0d7409175cefafa47ad0: Status 404 returned error can't find the container with id abdeb5c7ab6a988d1c84e084b501f37fdb60ed84594b0d7409175cefafa47ad0
Sep 16 13:07:49.773051 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:49.773018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerStarted","Data":"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"}
Sep 16 13:07:49.773441 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:49.773073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerStarted","Data":"abdeb5c7ab6a988d1c84e084b501f37fdb60ed84594b0d7409175cefafa47ad0"}
Sep 16 13:07:53.788080 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:53.788047    2571 generic.go:356] "Generic (PLEG): container finished" podID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerID="6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b" exitCode=0
Sep 16 13:07:53.788448 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:53.788087    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerDied","Data":"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"}
Sep 16 13:07:54.793953 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:54.793916    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerStarted","Data":"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"}
Sep 16 13:07:54.794324 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:54.793978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerStarted","Data":"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"}
Sep 16 13:07:54.794324 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:54.794209    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:54.818098 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:54.818050    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podStartSLOduration=3.6594284740000003 podStartE2EDuration="7.818035381s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.158606907s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:07:54.816009411 +0000 UTC m=+1217.871226917" watchObservedRunningTime="2026-09-16 13:07:54.818035381 +0000 UTC m=+1217.873252888"
Sep 16 13:07:55.797245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:55.797213    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:07:55.798429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:55.798402    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:07:56.800340 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:07:56.800301    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:01.804323 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:01.804292    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:08:01.804777 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:01.804748    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:11.805101 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:11.805059    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:21.805566 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:21.805530    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:27.509451 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:27.509407    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:31.805010 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:31.804936    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:41.270519 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:41.270488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:41.804983 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:41.804945    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:08:51.805495 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:08:51.805457    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:09:01.804728 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:01.804680    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Sep 16 13:09:05.431904 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:05.431853    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:09:17.651210 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:17.651173    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:09:17.651824 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:17.651490    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container" containerID="cri-o://0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502" gracePeriod=30
Sep 16 13:09:17.651824 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:17.651512    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kube-rbac-proxy" containerID="cri-o://884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08" gracePeriod=30
Sep 16 13:09:17.752234 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:17.752197    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:17.807209 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:17.807184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:18.086239 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:18.086210    2571 generic.go:356] "Generic (PLEG): container finished" podID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerID="884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08" exitCode=2
Sep 16 13:09:18.086400 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:18.086252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerDied","Data":"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"}
Sep 16 13:09:21.791417 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.791392    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:09:21.888886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.888782    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm8mv\" (UniqueName: \"kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv\") pod \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") "
Sep 16 13:09:21.888886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.888832    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert\") pod \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") "
Sep 16 13:09:21.888886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.888883    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config\") pod \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") "
Sep 16 13:09:21.889134 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.888974    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location\") pod \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") "
Sep 16 13:09:21.889134 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.889054    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") pod \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\" (UID: \"4cec1e1c-3fc2-4839-a0a3-118ca3822b42\") "
Sep 16 13:09:21.889245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.889166    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4cec1e1c-3fc2-4839-a0a3-118ca3822b42" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:21.889245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.889228    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4cec1e1c-3fc2-4839-a0a3-118ca3822b42" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:21.889352 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.889263    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-cabundle-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:09:21.889352 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.889266    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4cec1e1c-3fc2-4839-a0a3-118ca3822b42" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:21.890802 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.890783    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv" (OuterVolumeSpecName: "kube-api-access-lm8mv") pod "4cec1e1c-3fc2-4839-a0a3-118ca3822b42" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42"). InnerVolumeSpecName "kube-api-access-lm8mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:21.890979 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.890959    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4cec1e1c-3fc2-4839-a0a3-118ca3822b42" (UID: "4cec1e1c-3fc2-4839-a0a3-118ca3822b42"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:09:21.989880 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.989850    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:09:21.990003 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.989890    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kserve-provision-location\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:09:21.990003 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.989904    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:09:21.990003 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:21.989918    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm8mv\" (UniqueName: \"kubernetes.io/projected/4cec1e1c-3fc2-4839-a0a3-118ca3822b42-kube-api-access-lm8mv\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:09:22.101743 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.101718    2571 generic.go:356] "Generic (PLEG): container finished" podID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerID="0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502" exitCode=0
Sep 16 13:09:22.101886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.101769    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"
Sep 16 13:09:22.101886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.101804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerDied","Data":"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"}
Sep 16 13:09:22.101886 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.101879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp" event={"ID":"4cec1e1c-3fc2-4839-a0a3-118ca3822b42","Type":"ContainerDied","Data":"abdeb5c7ab6a988d1c84e084b501f37fdb60ed84594b0d7409175cefafa47ad0"}
Sep 16 13:09:22.102012 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.101894    2571 scope.go:117] "RemoveContainer" containerID="884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"
Sep 16 13:09:22.109943 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.109925    2571 scope.go:117] "RemoveContainer" containerID="0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"
Sep 16 13:09:22.116610 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.116594    2571 scope.go:117] "RemoveContainer" containerID="6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"
Sep 16 13:09:22.122938 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.122917    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:09:22.123299 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.123279    2571 scope.go:117] "RemoveContainer" containerID="884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"
Sep 16 13:09:22.123567 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:09:22.123549    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08\": container with ID starting with 884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08 not found: ID does not exist" containerID="884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"
Sep 16 13:09:22.123625 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.123572    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08"} err="failed to get container status \"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08\": rpc error: code = NotFound desc = could not find container \"884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08\": container with ID starting with 884a27bb40f8b81a579b2f6e8d797b562414a4405f28988be789e16d0d66ed08 not found: ID does not exist"
Sep 16 13:09:22.123625 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.123589    2571 scope.go:117] "RemoveContainer" containerID="0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"
Sep 16 13:09:22.123802 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:09:22.123786    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502\": container with ID starting with 0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502 not found: ID does not exist" containerID="0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"
Sep 16 13:09:22.123842 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.123808    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502"} err="failed to get container status \"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502\": rpc error: code = NotFound desc = could not find container \"0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502\": container with ID starting with 0377270ee886b429133b704234cfdb364896c3bc68002bf4647909dfa8645502 not found: ID does not exist"
Sep 16 13:09:22.123842 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.123820    2571 scope.go:117] "RemoveContainer" containerID="6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"
Sep 16 13:09:22.124063 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:09:22.124045    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b\": container with ID starting with 6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b not found: ID does not exist" containerID="6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"
Sep 16 13:09:22.124107 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.124067    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b"} err="failed to get container status \"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b\": rpc error: code = NotFound desc = could not find container \"6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b\": container with ID starting with 6974aad58ac734a9e1d08cde4b8077e1dfef98ddef23f5ede314083f76799b4b not found: ID does not exist"
Sep 16 13:09:22.126253 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.126235    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-8cb968449-mh7rp"]
Sep 16 13:09:22.778007 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.777974    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:22.855431 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.855400    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:22.935659 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:22.935626    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:23.151603 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:23.151523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:23.431973 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:09:23.431945    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" path="/var/lib/kubelet/pods/4cec1e1c-3fc2-4839-a0a3-118ca3822b42/volumes"
Sep 16 13:10:46.344204 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:10:46.344167    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:52.914246 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:10:52.914209    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:54.721629 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:10:54.721592    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:54.798117 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:10:54.798088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:11.345596 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:11.345557    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:23.172025 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:23.171993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:37.008502 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:37.008465    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:37.074826 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:37.074791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:37.465885 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:37.465850    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:12:37.467080 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:37.467061    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:12:47.049910 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.049855    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:47.088311 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088283    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:12:47.088528 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088517    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="storage-initializer"
Sep 16 13:12:47.088572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088529    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="storage-initializer"
Sep 16 13:12:47.088572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088538    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container"
Sep 16 13:12:47.088572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088544    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container"
Sep 16 13:12:47.088572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088551    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kube-rbac-proxy"
Sep 16 13:12:47.088572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088556    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kube-rbac-proxy"
Sep 16 13:12:47.088726 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088601    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kserve-container"
Sep 16 13:12:47.088726 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.088608    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cec1e1c-3fc2-4839-a0a3-118ca3822b42" containerName="kube-rbac-proxy"
Sep 16 13:12:47.091492 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.091477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.095428 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095408    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-cipn-predictor-serving-cert\""
Sep 16 13:12:47.095548 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 16 13:12:47.095709 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095695    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-cipn-kube-rbac-proxy-sar-config\""
Sep 16 13:12:47.095777 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 16 13:12:47.095907 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095894    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 16 13:12:47.095981 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.095933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9sk5b\""
Sep 16 13:12:47.096823 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.096779    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 16 13:12:47.103017 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.102996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:12:47.137527 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.137506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.137636 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.137551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.137636 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.137580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.137715 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.137649    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf28f\" (UniqueName: \"kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.137715 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.137674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238391 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238544 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238544 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238435    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238544 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf28f\" (UniqueName: \"kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238544 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.238911 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.238891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.239141 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.239125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.239185 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.239156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.240855 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.240833    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.257427 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.257406    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf28f\" (UniqueName: \"kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f\") pod \"isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.282519 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.282488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:47.402056 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.401976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:47.671243 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.671219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:12:47.673167 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:12:47.673132    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0155579_6d5b_41e9_84aa_975023750f22.slice/crio-8bcbe9417814cd14310fabced9fc51e49fcb51df9051a05f19a622d7ac7a4964 WatchSource:0}: Error finding container 8bcbe9417814cd14310fabced9fc51e49fcb51df9051a05f19a622d7ac7a4964: Status 404 returned error can't find the container with id 8bcbe9417814cd14310fabced9fc51e49fcb51df9051a05f19a622d7ac7a4964
Sep 16 13:12:47.811211 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.811176    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerStarted","Data":"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"}
Sep 16 13:12:47.811394 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:47.811307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerStarted","Data":"8bcbe9417814cd14310fabced9fc51e49fcb51df9051a05f19a622d7ac7a4964"}
Sep 16 13:12:51.827629 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:51.827536    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0155579-6d5b-41e9-84aa-975023750f22" containerID="72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb" exitCode=0
Sep 16 13:12:51.827629 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:51.827584    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerDied","Data":"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"}
Sep 16 13:12:52.833986 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.833950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerStarted","Data":"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"}
Sep 16 13:12:52.834388 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.834027    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerStarted","Data":"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"}
Sep 16 13:12:52.834388 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.834054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerStarted","Data":"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"}
Sep 16 13:12:52.834388 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.834302    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:52.834508 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.834451    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:52.835860 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.835835    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:12:52.858580 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:52.858537    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podStartSLOduration=2.107887002 podStartE2EDuration="5.858525872s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.75063887s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:12:52.856520884 +0000 UTC m=+1515.911738392" watchObservedRunningTime="2026-09-16 13:12:52.858525872 +0000 UTC m=+1515.913743379"
Sep 16 13:12:53.837943 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:53.837904    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:53.838305 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:53.838101    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:12:53.839197 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:53.839169    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:12:54.842365 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:54.842315    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:12:54.842816 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:54.842727    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:12:59.847245 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:59.847215    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:12:59.849585 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:59.847715    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:12:59.849585 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:12:59.848137    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:09.847817 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:09.847778    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:09.848259 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:09.848018    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:19.847764 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:19.847720    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:19.848340 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:19.848292    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:29.848116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:29.848068    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:29.848538 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:29.848511    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:39.848467 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:39.848423    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:39.848929 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:39.848907    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:49.848123 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:49.848080    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:49.848628 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:49.848600    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:13:59.847935 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:59.847881    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:13:59.848477 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:13:59.848417    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:14:09.848206 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:09.848175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:09.848699 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:09.848678    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:22.390493 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:22.390462    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:14:22.390944 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:22.390687    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" containerID="cri-o://d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04" gracePeriod=30
Sep 16 13:14:22.390944 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:22.390708    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" containerID="cri-o://8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7" gracePeriod=30
Sep 16 13:14:22.390944 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:22.390825    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" containerID="cri-o://8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13" gracePeriod=30
Sep 16 13:14:23.157095 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:23.157060    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0155579-6d5b-41e9-84aa-975023750f22" containerID="8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13" exitCode=2
Sep 16 13:14:23.157266 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:23.157143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerDied","Data":"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"}
Sep 16 13:14:23.299381 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:23.299353    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:24.766022 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:24.765979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:24.843157 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:24.843123    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:27.173203 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:27.173167    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0155579-6d5b-41e9-84aa-975023750f22" containerID="d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04" exitCode=0
Sep 16 13:14:27.173548 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:27.173228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerDied","Data":"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"}
Sep 16 13:14:29.843572 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:29.843532    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:29.848211 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:29.848180    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:14:29.849425 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:29.849402    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:14:34.842951 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:34.842912    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:34.843365 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:34.843027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:39.417278 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.417245    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:39.439062 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.439021    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:39.448429 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.448405    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:39.457893 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.457855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:39.843481 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.843446    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:39.848109 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.848087    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:14:39.849190 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:39.849165    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:14:40.273657 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:40.273626    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:40.288241 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:40.288219    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:40.298234 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:40.298213    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:40.307817 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:40.307795    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:41.123261 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.123232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:41.135476 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.135455    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:41.144948 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.144931    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:41.154236 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.154219    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:41.961524 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.961497    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:41.971806 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.971780    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:41.980409 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.980387    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:41.990703 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:41.990678    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:42.771560 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:42.771533    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:42.782800 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:42.782773    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:42.791730 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:42.791710    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:42.800585 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:42.800570    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:43.593606 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:43.593578    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:43.604739 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:43.604716    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:43.614186 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:43.614162    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:43.623547 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:43.623520    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:44.412097 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:44.412072    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:44.422602 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:44.422582    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:44.431806 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:44.431786    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:44.441458 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:44.441438    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:44.843510 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:44.843481    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:45.237286 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:45.237263    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:45.249074 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:45.249056    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:45.258823 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:45.258804    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:45.269104 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:45.269086    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:46.056071 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.056045    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:46.067541 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.067518    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:46.076500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.076483    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:46.085327 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.085303    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:46.877937 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.877912    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:46.888178 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.888159    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:46.897419 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.897404    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:46.907424 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:46.907409    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:47.777894 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:47.777852    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:47.788206 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:47.788184    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:47.798118 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:47.798097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:47.807893 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:47.807858    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:48.593555 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:48.593531    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:48.606409 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:48.606388    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:48.619135 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:48.619119    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:48.629517 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:48.629501    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:49.419606 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.419581    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:49.429744 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.429716    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:49.438275 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.438259    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:49.447534 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.447517    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:49.843406 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.843372    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Sep 16 13:14:49.848093 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.848070    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 13:14:49.848190 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.848170    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:49.849189 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.849166    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Sep 16 13:14:49.849299 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:49.849287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:50.279989 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:50.279960    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kserve-container/0.log"
Sep 16 13:14:50.300039 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:50.300013    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/kube-rbac-proxy/0.log"
Sep 16 13:14:50.313223 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:50.313205    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/agent/0.log"
Sep 16 13:14:50.323074 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:50.323053    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66_e0155579-6d5b-41e9-84aa-975023750f22/storage-initializer/0.log"
Sep 16 13:14:52.533028 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.533004    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:52.568327 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568304    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf28f\" (UniqueName: \"kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f\") pod \"e0155579-6d5b-41e9-84aa-975023750f22\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") "
Sep 16 13:14:52.568440 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568365    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert\") pod \"e0155579-6d5b-41e9-84aa-975023750f22\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") "
Sep 16 13:14:52.568440 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568406    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location\") pod \"e0155579-6d5b-41e9-84aa-975023750f22\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") "
Sep 16 13:14:52.568522 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568471    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls\") pod \"e0155579-6d5b-41e9-84aa-975023750f22\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") "
Sep 16 13:14:52.568522 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568495    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config\") pod \"e0155579-6d5b-41e9-84aa-975023750f22\" (UID: \"e0155579-6d5b-41e9-84aa-975023750f22\") "
Sep 16 13:14:52.568829 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568745    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e0155579-6d5b-41e9-84aa-975023750f22" (UID: "e0155579-6d5b-41e9-84aa-975023750f22"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:14:52.568829 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568750    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e0155579-6d5b-41e9-84aa-975023750f22" (UID: "e0155579-6d5b-41e9-84aa-975023750f22"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:14:52.569011 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.568948    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e0155579-6d5b-41e9-84aa-975023750f22" (UID: "e0155579-6d5b-41e9-84aa-975023750f22"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:14:52.570332 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.570311    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f" (OuterVolumeSpecName: "kube-api-access-hf28f") pod "e0155579-6d5b-41e9-84aa-975023750f22" (UID: "e0155579-6d5b-41e9-84aa-975023750f22"). InnerVolumeSpecName "kube-api-access-hf28f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:14:52.570417 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.570389    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e0155579-6d5b-41e9-84aa-975023750f22" (UID: "e0155579-6d5b-41e9-84aa-975023750f22"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:14:52.669379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.669328    2571 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0155579-6d5b-41e9-84aa-975023750f22-kserve-provision-location\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:14:52.669379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.669348    2571 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e0155579-6d5b-41e9-84aa-975023750f22-proxy-tls\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:14:52.669379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.669357    2571 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:14:52.669379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.669365    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf28f\" (UniqueName: \"kubernetes.io/projected/e0155579-6d5b-41e9-84aa-975023750f22-kube-api-access-hf28f\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:14:52.669379 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:52.669373    2571 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e0155579-6d5b-41e9-84aa-975023750f22-cabundle-cert\") on node \"ip-10-0-131-158.ec2.internal\" DevicePath \"\""
Sep 16 13:14:53.262852 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.262816    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0155579-6d5b-41e9-84aa-975023750f22" containerID="8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7" exitCode=0
Sep 16 13:14:53.263064 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.262889    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"
Sep 16 13:14:53.263064 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.262903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerDied","Data":"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"}
Sep 16 13:14:53.263064 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.263013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66" event={"ID":"e0155579-6d5b-41e9-84aa-975023750f22","Type":"ContainerDied","Data":"8bcbe9417814cd14310fabced9fc51e49fcb51df9051a05f19a622d7ac7a4964"}
Sep 16 13:14:53.263064 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.263060    2571 scope.go:117] "RemoveContainer" containerID="8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"
Sep 16 13:14:53.271425 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.271410    2571 scope.go:117] "RemoveContainer" containerID="8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"
Sep 16 13:14:53.278346 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.278333    2571 scope.go:117] "RemoveContainer" containerID="d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"
Sep 16 13:14:53.285178 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.285163    2571 scope.go:117] "RemoveContainer" containerID="72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"
Sep 16 13:14:53.286348 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.286329    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:14:53.290389 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.290372    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-64c6cf64bf-wxc66"]
Sep 16 13:14:53.292474 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.292460    2571 scope.go:117] "RemoveContainer" containerID="8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"
Sep 16 13:14:53.292723 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:14:53.292706    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7\": container with ID starting with 8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7 not found: ID does not exist" containerID="8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"
Sep 16 13:14:53.292795 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.292735    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7"} err="failed to get container status \"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7\": rpc error: code = NotFound desc = could not find container \"8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7\": container with ID starting with 8e548e305baba853ce8e22fe60c26664695b9f9fc87ed3b379d55b88fd5325a7 not found: ID does not exist"
Sep 16 13:14:53.292795 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.292758    2571 scope.go:117] "RemoveContainer" containerID="8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"
Sep 16 13:14:53.293006 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:14:53.292989    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13\": container with ID starting with 8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13 not found: ID does not exist" containerID="8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"
Sep 16 13:14:53.293052 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.293011    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13"} err="failed to get container status \"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13\": rpc error: code = NotFound desc = could not find container \"8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13\": container with ID starting with 8892a8519cc1770a9913f1a5c6c0b5e6238733b4eba7b2e9c9a9cd374b6c8b13 not found: ID does not exist"
Sep 16 13:14:53.293052 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.293027    2571 scope.go:117] "RemoveContainer" containerID="d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"
Sep 16 13:14:53.293239 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:14:53.293224    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04\": container with ID starting with d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04 not found: ID does not exist" containerID="d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"
Sep 16 13:14:53.293275 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.293243    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04"} err="failed to get container status \"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04\": rpc error: code = NotFound desc = could not find container \"d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04\": container with ID starting with d213346d63c92c9f4f49d14428751fb00d25e5ea0ccb56b431bfc9ca50785c04 not found: ID does not exist"
Sep 16 13:14:53.293275 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.293255    2571 scope.go:117] "RemoveContainer" containerID="72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"
Sep 16 13:14:53.293433 ip-10-0-131-158 kubenswrapper[2571]: E0916 13:14:53.293416    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb\": container with ID starting with 72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb not found: ID does not exist" containerID="72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"
Sep 16 13:14:53.293484 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.293436    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb"} err="failed to get container status \"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb\": rpc error: code = NotFound desc = could not find container \"72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb\": container with ID starting with 72b6f0450f7e1bdca82e08d7520fafcf5488d45719cfff189f6d16e4b2e68cbb not found: ID does not exist"
Sep 16 13:14:53.431695 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:53.431671    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0155579-6d5b-41e9-84aa-975023750f22" path="/var/lib/kubelet/pods/e0155579-6d5b-41e9-84aa-975023750f22/volumes"
Sep 16 13:14:55.182547 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:55.182514    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:55.331307 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:55.331279    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:55.387416 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:55.387386    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:58.202730 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:58.202680    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cf2n6_1b1f5c44-2abf-42b5-9c4a-a883723de2ef/global-pull-secret-syncer/0.log"
Sep 16 13:14:58.235056 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:58.235030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log"
Sep 16 13:14:58.305393 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:14:58.305367    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-158.ec2.internal_3ed2df6b6d0932adc64ea3a34b652a6a/haproxy/0.log"
Sep 16 13:15:00.919471 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:00.919440    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:00.987250 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:00.987221    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gcgmg_7641836f-d23e-4e56-af2b-0b45ddcaf321/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:02.772154 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:02.772125    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjw5x_fb8f8b3e-9415-4634-9852-2c3c04c529c6/node-exporter/0.log"
Sep 16 13:15:02.792457 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:02.792432    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjw5x_fb8f8b3e-9415-4634-9852-2c3c04c529c6/kube-rbac-proxy/0.log"
Sep 16 13:15:02.814664 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:02.814645    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tjw5x_fb8f8b3e-9415-4634-9852-2c3c04c529c6/init-textfile/0.log"
Sep 16 13:15:07.037462 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.037434    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42j8j_1becb811-3996-42e5-8ddc-59d25b935b9e/dns/0.log"
Sep 16 13:15:07.055054 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.055032    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42j8j_1becb811-3996-42e5-8ddc-59d25b935b9e/kube-rbac-proxy/0.log"
Sep 16 13:15:07.131829 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.131805    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"]
Sep 16 13:15:07.132073 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132060    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container"
Sep 16 13:15:07.132116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132077    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container"
Sep 16 13:15:07.132116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132093    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy"
Sep 16 13:15:07.132116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132100    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy"
Sep 16 13:15:07.132116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132106    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent"
Sep 16 13:15:07.132116 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132111    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent"
Sep 16 13:15:07.132269 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132124    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="storage-initializer"
Sep 16 13:15:07.132269 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132129    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="storage-initializer"
Sep 16 13:15:07.132269 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132174    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="agent"
Sep 16 13:15:07.132269 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132183    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kube-rbac-proxy"
Sep 16 13:15:07.132269 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.132190    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0155579-6d5b-41e9-84aa-975023750f22" containerName="kserve-container"
Sep 16 13:15:07.136714 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.136690    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.139309 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.139290    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l458r\"/\"default-dockercfg-rmglt\""
Sep 16 13:15:07.139587 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.139571    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l458r\"/\"kube-root-ca.crt\""
Sep 16 13:15:07.140492 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.140476    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l458r\"/\"openshift-service-ca.crt\""
Sep 16 13:15:07.144243 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.144224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"]
Sep 16 13:15:07.168014 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.167988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfvkh\" (UniqueName: \"kubernetes.io/projected/4bde218f-ea7b-49d4-9e89-e063bfd33a45-kube-api-access-rfvkh\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.168107 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.168026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-podres\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.168107 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.168064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-sys\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.168192 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.168137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-proc\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.168192 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.168163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-lib-modules\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.227399 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.227377    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbfkt_2012aa80-b2f4-43a7-b039-790ec85dd647/dns-node-resolver/0.log"
Sep 16 13:15:07.269299 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269278    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-podres\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269377 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-sys\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269377 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-proc\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269377 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-lib-modules\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfvkh\" (UniqueName: \"kubernetes.io/projected/4bde218f-ea7b-49d4-9e89-e063bfd33a45-kube-api-access-rfvkh\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-sys\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269423    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-proc\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269500 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-podres\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.269635 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.269524    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bde218f-ea7b-49d4-9e89-e063bfd33a45-lib-modules\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.277375 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.277356    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfvkh\" (UniqueName: \"kubernetes.io/projected/4bde218f-ea7b-49d4-9e89-e063bfd33a45-kube-api-access-rfvkh\") pod \"perf-node-gather-daemonset-6m9tr\" (UID: \"4bde218f-ea7b-49d4-9e89-e063bfd33a45\") " pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.446314 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.446291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:07.713017 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.712996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"]
Sep 16 13:15:07.714970 ip-10-0-131-158 kubenswrapper[2571]: W0916 13:15:07.714942    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4bde218f_ea7b_49d4_9e89_e063bfd33a45.slice/crio-b8d2881a9309f5eefc39c2a7172aff0d9907e505da6fd42fd02bbde4a8ad88b0 WatchSource:0}: Error finding container b8d2881a9309f5eefc39c2a7172aff0d9907e505da6fd42fd02bbde4a8ad88b0: Status 404 returned error can't find the container with id b8d2881a9309f5eefc39c2a7172aff0d9907e505da6fd42fd02bbde4a8ad88b0
Sep 16 13:15:07.718983 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:07.718963    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59cfr_559aa60c-8f8d-44a2-a7f9-e46d0dcb1219/node-ca/0.log"
Sep 16 13:15:08.318700 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:08.318666    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr" event={"ID":"4bde218f-ea7b-49d4-9e89-e063bfd33a45","Type":"ContainerStarted","Data":"8801a1f28c1b452176c37f900cd5d1070e911296cafb75ac66c19cd3275673d3"}
Sep 16 13:15:08.319092 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:08.318725    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr" event={"ID":"4bde218f-ea7b-49d4-9e89-e063bfd33a45","Type":"ContainerStarted","Data":"b8d2881a9309f5eefc39c2a7172aff0d9907e505da6fd42fd02bbde4a8ad88b0"}
Sep 16 13:15:08.319092 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:08.318766    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:08.335339 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:08.335298    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr" podStartSLOduration=1.3352826420000001 podStartE2EDuration="1.335282642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:15:08.335182119 +0000 UTC m=+1651.390399631" watchObservedRunningTime="2026-09-16 13:15:08.335282642 +0000 UTC m=+1651.390500182"
Sep 16 13:15:08.839034 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:08.839007    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2p5px_b3a0023e-d500-4b14-86aa-ef9f42fe4c17/serve-healthcheck-canary/0.log"
Sep 16 13:15:09.286934 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:09.286912    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf9s5_0f3a2586-31c9-46a4-bd01-502b273de9f0/kube-rbac-proxy/0.log"
Sep 16 13:15:09.303053 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:09.303034    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf9s5_0f3a2586-31c9-46a4-bd01-502b273de9f0/exporter/0.log"
Sep 16 13:15:09.319296 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:09.319276    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kf9s5_0f3a2586-31c9-46a4-bd01-502b273de9f0/extractor/0.log"
Sep 16 13:15:11.618455 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:11.618424    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-nt8wn_df6c899b-3a30-4862-8efb-3091725df44b/manager/0.log"
Sep 16 13:15:11.807426 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:11.807399    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-jfbqz_20d3d810-94e1-4c53-9fdb-a7f124b5a1d2/seaweedfs/0.log"
Sep 16 13:15:14.331426 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:14.331397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l458r/perf-node-gather-daemonset-6m9tr"
Sep 16 13:15:17.005871 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.005832    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6r4fn_560704e3-69c7-4f25-b83f-a95ac5daaf20/kube-multus/0.log"
Sep 16 13:15:17.464560 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.464537    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/kube-multus-additional-cni-plugins/0.log"
Sep 16 13:15:17.485113 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.485094    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/egress-router-binary-copy/0.log"
Sep 16 13:15:17.503298 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.503278    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/cni-plugins/0.log"
Sep 16 13:15:17.520221 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.520203    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/bond-cni-plugin/0.log"
Sep 16 13:15:17.536468 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.536445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/routeoverride-cni/0.log"
Sep 16 13:15:17.553566 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.553549    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/whereabouts-cni-bincopy/0.log"
Sep 16 13:15:17.572371 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.572349    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z9zbp_759b6e1c-4047-4845-ab55-db7f80e64d4c/whereabouts-cni/0.log"
Sep 16 13:15:17.687491 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.687468    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hw5xf_b0a0792b-ccec-456b-88d2-b6fa4b2793dd/network-metrics-daemon/0.log"
Sep 16 13:15:17.713196 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:17.713147    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hw5xf_b0a0792b-ccec-456b-88d2-b6fa4b2793dd/kube-rbac-proxy/0.log"
Sep 16 13:15:18.874020 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.873972    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-controller/0.log"
Sep 16 13:15:18.888450 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.888422    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/1.log"
Sep 16 13:15:18.888579 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.888486    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovn-acl-logging/0.log"
Sep 16 13:15:18.902874 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.902850    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/kube-rbac-proxy-node/0.log"
Sep 16 13:15:18.923253 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.923228    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/kube-rbac-proxy-ovn-metrics/0.log"
Sep 16 13:15:18.936942 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.936924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/northd/0.log"
Sep 16 13:15:18.952373 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.952358    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/nbdb/0.log"
Sep 16 13:15:18.983627 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:18.983609    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/sbdb/0.log"
Sep 16 13:15:19.020480 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:19.020462    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rwjbf_10e50322-039a-4fa1-bb74-75f2d5d9beb1/ovnkube-controller/0.log"
Sep 16 13:15:20.020146 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:20.020122    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bcj6t_e362580d-aba7-45a2-90ea-1f75850c89d8/network-check-target-container/0.log"
Sep 16 13:15:20.968999 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:20.968972    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-h6lwj_b2436c9c-8df6-4a32-8122-5e3e9a7c3e0e/iptables-alerter/0.log"
Sep 16 13:15:21.587412 ip-10-0-131-158 kubenswrapper[2571]: I0916 13:15:21.587390    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4sxjw_486d0c13-c93d-49d2-8ba1-74ad247308ed/tuned/0.log"