Sep 18 16:13:36.584002 ip-10-0-128-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 16:13:36.584012 ip-10-0-128-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 16:13:36.584020 ip-10-0-128-224 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 16:13:36.584167 ip-10-0-128-224 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 16:13:47.662145 ip-10-0-128-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 16:13:47.662161 ip-10-0-128-224 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7b1ffe2ed7b54ac98198710c681b42db --
Sep 18 16:15:42.299006 ip-10-0-128-224 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 16:15:42.675813 ip-10-0-128-224 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:15:42.675813 ip-10-0-128-224 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 16:15:42.675813 ip-10-0-128-224 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:15:42.675813 ip-10-0-128-224 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 16:15:42.675813 ip-10-0-128-224 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 16:15:42.677390 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.677301    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 16:15:42.681004 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.680987    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.681004 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681004    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681008    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681011    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681014    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681018    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681021    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681024    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681028    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681032    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681036    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681039    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681043    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681046    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681049    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681052    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681055    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681058    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681067    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681070    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681073    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.681069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681076    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681079    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681082    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681085    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681087    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681091    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681095    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681099    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681102    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681105    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681108    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681111    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681113    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681116    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681119    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681122    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681124    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681127    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681129    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.681542 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681132    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681134    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681136    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681139    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681142    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681144    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681147    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681149    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681152    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681154    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681157    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681160    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681162    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681165    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681167    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681171    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681174    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681176    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681179    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681182    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.682025 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681184    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681186    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681189    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681192    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681194    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681197    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681200    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681203    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681206    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681208    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681211    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681213    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681216    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681218    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681221    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681224    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681226    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681228    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681231    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681235    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.682511 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681239    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681241    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681244    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681246    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681249    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681251    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681255    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681258    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681261    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681263    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681266    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681268    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681271    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681274    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681277    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681279    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681282    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681284    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.681287    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.683013 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682037    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682045    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682048    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682051    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682055    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682059    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682062    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682066    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682069    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682072    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682074    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682077    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682080    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682082    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682085    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682088    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682090    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682093    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682096    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682100    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.683548 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682102    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682105    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682108    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682110    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682113    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682116    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682118    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682121    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682123    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682126    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682128    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682131    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682133    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682136    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682139    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682141    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682144    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682147    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682149    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682152    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.684090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682154    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682157    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682159    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682162    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682164    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682167    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682170    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682173    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682175    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682178    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682181    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682184    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682187    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682190    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682192    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682195    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682198    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682200    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682203    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682206    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.684867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682208    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682211    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682213    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682216    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682219    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682221    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682225    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682227    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682230    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682232    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682235    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682237    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682241    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682244    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682246    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682249    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682251    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682255    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682259    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.685402 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682263    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682266    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682268    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682271    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682273    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682280    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682282    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682286    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682289    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682292    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682295    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682297    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682300    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682304    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682308    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682311    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682314    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682317    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682320    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.685900 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682322    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682718    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682723    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682727    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682730    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682733    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682736    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682739    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682742    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682750    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682754    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682757    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682760    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682762    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682766    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682769    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682771    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682775    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682778    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682781    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.686375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682784    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682787    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682789    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682792    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682794    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682797    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682799    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682802    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682804    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682807    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682810    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682812    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682814    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682817    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682819    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682822    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682824    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682827    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682830    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682832    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.686887 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682838    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682842    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682845    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682848    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682852    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682855    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682858    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682861    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682863    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682866    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682869    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682872    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682874    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682877    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682879    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682882    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682885    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682887    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682890    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682892    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.687388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682895    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682897    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682900    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682903    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682905    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682908    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682910    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682913    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682918    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682921    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682924    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682927    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682930    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682933    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682936    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682939    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682941    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682944    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682947    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682949    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.687893 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682952    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682954    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682957    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682959    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682962    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682965    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682968    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682970    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682974    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682976    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682979    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682981    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682984    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682986    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682989    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682992    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.682998    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.683003    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.683008    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.683021    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.688418 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683099    2552 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683133    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683147    2552 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683152    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683162    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683165    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683172    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683176    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683180    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683183    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683187    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683190    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683193    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683196    2552 flags.go:64] FLAG: --cgroup-root=""
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683199    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683202    2552 flags.go:64] FLAG: --client-ca-file=""
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683205    2552 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683209    2552 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683212    2552 flags.go:64] FLAG: --cluster-domain=""
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683215    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683218    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683221    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683225    2552 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683228    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 16:15:42.688919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683231    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683235    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683238    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683241    2552 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683244    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683248    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683251    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683254    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683258    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683261    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683264    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683267    2552 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683272    2552 flags.go:64] FLAG: --enable-server="true"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683275    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683718    2552 flags.go:64] FLAG: --event-burst="100"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683722    2552 flags.go:64] FLAG: --event-qps="50"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683726    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683729    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683732    2552 flags.go:64] FLAG: --eviction-hard=""
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683736    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683739    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683742    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683746    2552 flags.go:64] FLAG: --eviction-soft=""
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683749    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683752    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 16:15:42.689497 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683755    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683759    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683762    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683765    2552 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683768    2552 flags.go:64] FLAG: --feature-gates=""
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683772    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683775    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683778    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683781    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683784    2552 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683788    2552 flags.go:64] FLAG: --help="false"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683791    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-128-224.ec2.internal"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683794    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683797    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683800    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683803    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683807    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683810    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683813    2552 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683817    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683820    2552 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683826    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683829    2552 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683832    2552 flags.go:64] FLAG: --kube-reserved=""
Sep 18 16:15:42.690142 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683835    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683838    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683841    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683844    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683847    2552 flags.go:64] FLAG: --lock-file=""
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683850    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683853    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683856    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683861    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683864    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683868    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683871    2552 flags.go:64] FLAG: --logging-format="text"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683874    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683877    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683880    2552 flags.go:64] FLAG: --manifest-url=""
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683883    2552 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683887    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683890    2552 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683894    2552 flags.go:64] FLAG: --max-pods="110"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683897    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683901    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683904    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683907    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683910    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683913    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 16:15:42.690836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683915    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683923    2552 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683926    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683929    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683934    2552 flags.go:64] FLAG: --pod-cidr=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.683936    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684039    2552 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684046    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684052    2552 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684057    2552 flags.go:64] FLAG: --port="10250"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684063    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684068    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0306202d8424a90e3"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684074    2552 flags.go:64] FLAG: --qos-reserved=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684080    2552 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684085    2552 flags.go:64] FLAG: --register-node="true"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684097    2552 flags.go:64] FLAG: --register-with-taints=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684104    2552 flags.go:64] FLAG: --registry-burst="10"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.684109    2552 flags.go:64] FLAG: --registry-qps="5"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686161    2552 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686179    2552 flags.go:64] FLAG: --reserved-memory=""
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686186    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686190    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686194    2552 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686198    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686201    2552 flags.go:64] FLAG: --runonce="false"
Sep 18 16:15:42.691440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686315    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686323    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686327    2552 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686331    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686334    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686338    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686341    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686344    2552 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686347    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686350    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686353    2552 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686356    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686359    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686362    2552 flags.go:64] FLAG: --system-cgroups=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686366    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686376    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686379    2552 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686383    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686389    2552 flags.go:64] FLAG: --tls-min-version=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686392    2552 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686395    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686398    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686401    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686404    2552 flags.go:64] FLAG: --v="2"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686409    2552 flags.go:64] FLAG: --version="false"
Sep 18 16:15:42.692099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686413    2552 flags.go:64] FLAG: --vmodule=""
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686418    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.686421    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686544    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686548    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686552    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686556    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686559    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686562    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686565    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686568    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686571    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686573    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686576    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686579    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686581    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686584    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686586    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686589    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686592    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.692799 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686594    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686597    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686600    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686602    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686605    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686607    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686610    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686613    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686615    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686618    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686620    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686623    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686625    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686629    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686632    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686634    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686638    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686642    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686645    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.693667 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686648    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686650    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686653    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686656    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686658    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686661    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686664    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686666    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686669    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686671    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686674    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686687    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686690    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686693    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686696    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686699    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686702    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686704    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686706    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686709    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.694497 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686712    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686715    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686718    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686720    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686723    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686725    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686728    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686731    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686734    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686737    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686740    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686743    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686753    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686757    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686760    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686763    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686765    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686768    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686771    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.695365 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686773    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686776    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686779    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686781    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686784    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686787    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686789    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686792    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686796    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686799    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686805    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686808    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686810    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686814    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686818    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686821    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686824    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686827    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686830    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.696212 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686833    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686835    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686839    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686841    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.686844    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.687333    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.694939    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.694960    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.694987    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.694997    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695081    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695088    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695093    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695098    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695102    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.696902 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695107    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695111    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695116    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695120    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695125    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695129    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695134    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695138    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695142    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695146    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695150    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695155    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695160    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695164    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695168    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695172    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695177    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695181    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695185    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695189    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.697587 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695193    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695197    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695202    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695206    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695216    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695222    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695227    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695232    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695236    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695243    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695248    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695253    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695257    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695261    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695265    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695270    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695274    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695278    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695282    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.698375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695286    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695291    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695295    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695299    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695303    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695307    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695311    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695315    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695319    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695324    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695328    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695332    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695337    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695341    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695345    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695349    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695353    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695358    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695363    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695367    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.699002 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695371    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695375    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695379    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695383    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695387    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695391    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695395    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695399    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695403    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695408    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695412    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695416    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695420    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695424    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695429    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695433    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695437    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695441    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695446    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695450    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.699506 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695454    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695461    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695466    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695470    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695474    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695479    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695483    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695487    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695491    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695496    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695500    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695505    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695510    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695514    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.700095 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695518    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.695526    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695720    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695728    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695734    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695738    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695742    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695748    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695752    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695756    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695760    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695764    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695769    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695773    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 16:15:42.700438 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695778    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695782    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695786    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695790    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695794    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695799    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695803    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695807    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695812    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695819    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695824    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695829    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695833    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695838    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695842    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695846    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695852    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695856    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695861    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 16:15:42.700875 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695865    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695869    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695874    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695878    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695883    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695887    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695891    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695895    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695900    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695904    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695908    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695913    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695917    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695921    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695926    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695930    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695934    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695938    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695943    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695948    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 16:15:42.701369 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695952    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695957    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695961    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695965    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695969    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695974    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695978    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695983    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695989    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695994    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.695999    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696003    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696008    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696014    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696020    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696024    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696029    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696034    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696038    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 16:15:42.701956 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696042    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696046    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696051    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696056    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696060    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696065    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696069    2552 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696073    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696077    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696081    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696086    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696090    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696095    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696099    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696103    2552 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696107    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696111    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696115    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696122    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696126    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696130    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 16:15:42.702723 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696134    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696138    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696143    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696148    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696152    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696156    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696160    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:42.696164    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.696172    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.696327    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.698731    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.699717    2552 server.go:1019] "Starting client certificate rotation"
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.699825    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.699860    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 16:15:42.703265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.702477    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:15:42.709520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.709498    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 16:15:42.718501 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.718081    2552 log.go:25] "Validated CRI v1 runtime API"
Sep 18 16:15:42.720843 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.720825    2552 log.go:25] "Validated CRI v1 image API"
Sep 18 16:15:42.722380 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.722362    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 16:15:42.727820 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.727801    2552 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8d200025-84d1-4abf-ab88-082a53a27307:/dev/nvme0n1p3 913bae2e-2d1d-4733-9117-fecb53c848f3:/dev/nvme0n1p4]
Sep 18 16:15:42.727897 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.727820    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 16:15:42.728813 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.728796    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:15:42.733517 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.733410    2552 manager.go:216] Machine: {Timestamp:2026-09-18 16:15:42.73220584 +0000 UTC m=+0.320458388 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099696 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fd49da2d70b54d23fd453dd2d78ce SystemUUID:ec2fd49d-a2d7-0b54-d23f-d453dd2d78ce BootID:7b1ffe2e-d7b5-4ac9-8198-710c681b42db Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d1:9d:6b:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d1:9d:6b:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:b7:02:55:99:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 16:15:42.733517 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.733511    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 16:15:42.733713 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.733594    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 16:15:42.736171 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.736142    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 16:15:42.736306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.736173    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 16:15:42.736881 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.736871    2552 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 16:15:42.736926 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.736885    2552 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 16:15:42.736926 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.736893    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:15:42.737543 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.737534    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 16:15:42.738481 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.738471    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 16:15:42.742479 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742467    2552 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:15:42.742598 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742589    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 16:15:42.742639 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742621    2552 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 16:15:42.742639 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742632    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 16:15:42.742709 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742643    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 16:15:42.742709 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742652    2552 kubelet.go:398] "Adding apiserver pod source"
Sep 18 16:15:42.742709 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.742662    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 16:15:42.743089 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.743077    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:15:42.743139 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.743096    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 16:15:42.746846 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.746830    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 16:15:42.748767 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.748752    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 16:15:42.748845 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.748783    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 16:15:42.749727 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749713    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 16:15:42.749764 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749734    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 16:15:42.749764 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749741    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 16:15:42.749764 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749746    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 16:15:42.749764 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749755    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 16:15:42.749764 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749762    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749776    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749782    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749788    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749794    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749802    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 16:15:42.749902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.749807    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 16:15:42.750551 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.750539    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 16:15:42.750586 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.750553    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 16:15:42.753079 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.753055    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 16:15:42.753149 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.753114    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 16:15:42.753417 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.753402    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 16:15:42.754162 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.754149    2552 server.go:1268] "Started kubelet"
Sep 18 16:15:42.754286 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.754231    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 16:15:42.754286 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.754250    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 16:15:42.754383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.754348    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 16:15:42.755126 ip-10-0-128-224 systemd[1]: Started Kubernetes Kubelet.
Sep 18 16:15:42.755782 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.755761    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 16:15:42.758029 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.758014    2552 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 16:15:42.758843 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.758810    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 16:15:42.763636 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.763618    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 16:15:42.764028 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.760049    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-224.ec2.internal.18d676740e464a17  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-224.ec2.internal,UID:ip-10-0-128-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-224.ec2.internal,},FirstTimestamp:2026-09-18 16:15:42.754122263 +0000 UTC m=+0.342374811,LastTimestamp:2026-09-18 16:15:42.754122263 +0000 UTC m=+0.342374811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-224.ec2.internal,}"
Sep 18 16:15:42.764245 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.764216    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 16:15:42.764666 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.764645    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:42.765098 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765081    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 16:15:42.765098 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765084    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 16:15:42.765224 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765118    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 16:15:42.765224 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765204    2552 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 16:15:42.765224 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765215    2552 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 16:15:42.765404 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765390    2552 factory.go:55] Registering systemd factory
Sep 18 16:15:42.765459 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765409    2552 factory.go:223] Registration of the systemd container factory successfully
Sep 18 16:15:42.765631 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765615    2552 factory.go:153] Registering CRI-O factory
Sep 18 16:15:42.765667 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765635    2552 factory.go:223] Registration of the crio container factory successfully
Sep 18 16:15:42.765719 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765702    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 16:15:42.765753 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765723    2552 factory.go:103] Registering Raw factory
Sep 18 16:15:42.765753 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.765738    2552 manager.go:1196] Started watching for new ooms in manager
Sep 18 16:15:42.766209 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.766196    2552 manager.go:349] Starting recovery of all containers
Sep 18 16:15:42.767169 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.767143    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 16:15:42.767260 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.767179    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 16:15:42.770265 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.770240    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg7nw"
Sep 18 16:15:42.776854 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.776657    2552 manager.go:354] Recovery completed
Sep 18 16:15:42.777625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.777606    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg7nw"
Sep 18 16:15:42.782186 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.782173    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:42.783984 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.783965    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:42.784071 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.783995    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:42.784071 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.784006    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:42.784670 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.784650    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 16:15:42.784670 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.784666    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:42.784841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.784668    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 16:15:42.784841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.784781    2552 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 16:15:42.785880 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.785858    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:42.785962 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.785893    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:42.785962 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.785907    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:42.786930 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.786915    2552 policy_none.go:49] "None policy: Start"
Sep 18 16:15:42.786991 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.786936    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 16:15:42.786991 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.786949    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 16:15:42.789069 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.789057    2552 policy_none.go:47] "Start"
Sep 18 16:15:42.814357 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.814342    2552 manager.go:337] "Starting Device Plugin manager"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.814379    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.814389    2552 server.go:87] "Starting device plugin registration server"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.814815    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.814826    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.814925    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.815000    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.815009    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.815643    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 16:15:42.837775 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.815701    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:42.895649 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.895615    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 16:15:42.897036 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.897020    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 16:15:42.897100 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.897086    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 16:15:42.897148 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.897112    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 16:15:42.897192 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.897154    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 16:15:42.899915 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.899709    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:42.915955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.915930    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:42.916966 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.916947    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:42.917074 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.916983    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:42.917074 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.916997    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:42.917074 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.917026    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-224.ec2.internal"
Sep 18 16:15:42.923226 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.923209    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-224.ec2.internal"
Sep 18 16:15:42.923324 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.923236    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-224.ec2.internal\": node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:42.941759 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:42.941655    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:42.997841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.997811    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"]
Sep 18 16:15:42.997978 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.997889    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:42.999462 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.999440    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:42.999583 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.999479    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:42.999583 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:42.999492    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:43.001936 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.001922    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:43.002063 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002047    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.002121 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002087    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:43.002732 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002714    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:43.002732 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002727    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:43.002859 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002743    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:43.002859 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002758    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:43.002859 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002765    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:43.002859 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.002774    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:43.005070 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.005054    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.005118 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.005083    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 16:15:43.005845 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.005824    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 16:15:43.005845 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.005845    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 16:15:43.005947 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.005857    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeHasSufficientPID"
Sep 18 16:15:43.034319 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:43.034298    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-224.ec2.internal\" not found" node="ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.038595 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:43.038581    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-224.ec2.internal\" not found" node="ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.042621 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:43.042607    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:43.066380 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.066360    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.066452 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.066386    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.066452 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.066404    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64e53398dbf928ecaca3a4fe5d4a5d05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-224.ec2.internal\" (UID: \"64e53398dbf928ecaca3a4fe5d4a5d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.143605 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:43.143576    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:43.167332 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167306    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.167423 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167355    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64e53398dbf928ecaca3a4fe5d4a5d05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-224.ec2.internal\" (UID: \"64e53398dbf928ecaca3a4fe5d4a5d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.167423 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167375    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.167423 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167317    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.167423 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167409    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59460863c4fbb5924e4682eca1466157-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal\" (UID: \"59460863c4fbb5924e4682eca1466157\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.167542 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:43.167442    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64e53398dbf928ecaca3a4fe5d4a5d05-config\") pod \"kube-apiserver-proxy-ip-10-0-128-224.ec2.internal\" (UID: \"64e53398dbf928ecaca3a4fe5d4a5d05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:43.244705 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:43.244620    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.434533 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.434482    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:44.438626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.438604    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:44.442057 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.442033    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.542824 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.542780    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.643315 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.643231    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.743791 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.743756    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.794909 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.794880    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:44.796609 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.796597    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 16:15:44.796713 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.796698    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:15:44.796758 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.796706    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 16:15:44.844035 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.844002    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.880230 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.880193    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 16:10:43 +0000 UTC" deadline="2028-06-25 22:47:04.950083048 +0000 UTC"
Sep 18 16:15:44.880230 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.880221    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15510h31m20.069865276s"
Sep 18 16:15:44.944532 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:44.944498    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:44.968748 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:44.968714    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:45.020533 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:45.020495    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59460863c4fbb5924e4682eca1466157.slice/crio-7f54e4d84f2bdadaf3f8ca6e107f8ea166e0e2ab46824bca71b021bed307c66d WatchSource:0}: Error finding container 7f54e4d84f2bdadaf3f8ca6e107f8ea166e0e2ab46824bca71b021bed307c66d: Status 404 returned error can't find the container with id 7f54e4d84f2bdadaf3f8ca6e107f8ea166e0e2ab46824bca71b021bed307c66d
Sep 18 16:15:45.021344 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:45.021303    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e53398dbf928ecaca3a4fe5d4a5d05.slice/crio-f70f7759c649efbafadb9d2bd7629f337ab7769a7fd0f8fe7333a9f71e42d68c WatchSource:0}: Error finding container f70f7759c649efbafadb9d2bd7629f337ab7769a7fd0f8fe7333a9f71e42d68c: Status 404 returned error can't find the container with id f70f7759c649efbafadb9d2bd7629f337ab7769a7fd0f8fe7333a9f71e42d68c
Sep 18 16:15:45.026162 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.026147    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:15:45.044785 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.044755    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:45.145288 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.145254    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-224.ec2.internal\" not found"
Sep 18 16:15:45.214040 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.213949    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:45.262540 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.262513    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:45.273796 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.273778    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 16:15:45.274766 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.274754    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal"
Sep 18 16:15:45.281251 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.281237    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 16:15:45.837597 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.837565    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:45.841788 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.841748    2552 apiserver.go:52] "Watching apiserver"
Sep 18 16:15:45.851230 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.851203    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 16:15:45.853042 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.852706    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-zbhmz","openshift-ovn-kubernetes/ovnkube-node-xmk47","kube-system/global-pull-secret-syncer-dqnn7","kube-system/konnectivity-agent-s7rn9","kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal","openshift-dns/node-resolver-z2pp9","openshift-image-registry/node-ca-xqgrq","openshift-multus/multus-additional-cni-plugins-hc9z7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf","openshift-cluster-node-tuning-operator/tuned-l26z5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal","openshift-multus/multus-6bhgj","openshift-multus/network-metrics-daemon-9m57n","openshift-network-diagnostics/network-check-target-ch6l6"]
Sep 18 16:15:45.855263 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.855233    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.857515 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.857496    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.858884 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.858860    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-trwtz\""
Sep 18 16:15:45.859050 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.859027    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 16:15:45.859475 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.859227    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.859574 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.859498    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.860633 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.859879    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.860633 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.860175    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fllbm\""
Sep 18 16:15:45.860633 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.860410    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 16:15:45.860633 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.860470    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 16:15:45.860633 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.860412    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.861568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.861006    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 16:15:45.861568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.861172    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 16:15:45.862026 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.862007    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.862238 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.862193    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:45.865003 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.864663    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.866750 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.866731    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:45.868928 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.868912    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:45.871578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.871280    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.872472 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872452    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-system-cni-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.872566 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872485    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzw4\" (UniqueName: \"kubernetes.io/projected/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-kube-api-access-bqzw4\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.872566 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872512    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-kubelet-config\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.872566 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872533    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-dbus\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.872716 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872617    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0c50fd8-df66-4e5e-9c48-7439edc9682f-host\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.872716 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872644    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.872716 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872666    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-agent-certs\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.872716 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872689    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-konnectivity-ca\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.872869 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872729    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.872869 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872777    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.872869 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872804    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0c50fd8-df66-4e5e-9c48-7439edc9682f-serviceca\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.872869 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872831    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cnibin\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.872869 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872856    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.873151 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872881    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.873151 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.872938    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88llk\" (UniqueName: \"kubernetes.io/projected/d0c50fd8-df66-4e5e-9c48-7439edc9682f-kube-api-access-88llk\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.873915 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.873897    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:45.874035 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.873992    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:45.875226 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.875205    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.875340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.875322    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.876647 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.876347    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.877584 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.877566    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.878988 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.878603    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 16:15:45.878988 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.878659    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.879204 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.879188    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.879797 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.879778    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 16:15:45.880510 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.880493    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 16:15:45.881825 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.881571    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:45.881825 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.881627    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:45.882669 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.882646    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.882760 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.882679    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.882760 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.882679    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-55dsj\""
Sep 18 16:15:45.883953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.883921    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888215    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tkfs8\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888482    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wl54c\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888785    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888904    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888921    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888930    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.888953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888949    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kklg\""
Sep 18 16:15:45.889302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.888826    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 16:15:45.889302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889104    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 16:15:45.889625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889611    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 16:15:45.889730 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889713    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 16:15:45.889993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889817    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vj79p\""
Sep 18 16:15:45.889993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889719    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 16:15:45.889993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889676    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 16:15:45.889993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.889950    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jrhnt\""
Sep 18 16:15:45.890165 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.890048    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwhdt\""
Sep 18 16:15:45.898121 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.898100    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 16:15:45.933750 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.933715    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qxdm5"
Sep 18 16:15:45.941972 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.941943    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qxdm5"
Sep 18 16:15:45.965819 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.965066    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 16:15:45.973848 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973821    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-kubelet-config\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.973951 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973863    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwg99\" (UniqueName: \"kubernetes.io/projected/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-kube-api-access-lwg99\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.973951 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw289\" (UniqueName: \"kubernetes.io/projected/a86ddc9e-bec5-4042-bf08-ea934285eedb-kube-api-access-zw289\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.973951 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973918    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.973951 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973936    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-kubelet-config\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.973951 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973944    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-konnectivity-ca\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.973969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovn-node-metrics-cert\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974009    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974046    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-socket-dir-parent\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974118    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.974152    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:45.974241 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:45.974221    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.474199318 +0000 UTC m=+2.965155767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974257    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-var-lib-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974283    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-system-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974305    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-netns\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-kubelet\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974355    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cnibin\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974382    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974409    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88llk\" (UniqueName: \"kubernetes.io/projected/d0c50fd8-df66-4e5e-9c48-7439edc9682f-kube-api-access-88llk\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.974441 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974434    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5d2c\" (UniqueName: \"kubernetes.io/projected/c0c3628a-ed78-4b82-aa08-fd60e372fec9-kube-api-access-s5d2c\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974457    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s56x\" (UniqueName: \"kubernetes.io/projected/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-kube-api-access-2s56x\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974470    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cnibin\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974482    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-kubelet\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974504    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-host\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974539    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-konnectivity-ca\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974568    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974589    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-system-cni-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974618    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzw4\" (UniqueName: \"kubernetes.io/projected/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-kube-api-access-bqzw4\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974645    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-dbus\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974689    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-system-cni-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974704    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a497cea-5563-452c-a622-16becb8a0134-dbus\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:45.974784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974757    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-systemd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974808    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974836    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-tmp\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974863    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974882    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-cnibin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974908    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-agent-certs\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974916    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.974931    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-etc-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975009    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-run\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975028    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-sys\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975043    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ln2\" (UniqueName: \"kubernetes.io/projected/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kube-api-access-45ln2\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975057    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcflz\" (UniqueName: \"kubernetes.io/projected/7d77dd56-a175-4a39-8314-155bb5e40fa6-kube-api-access-bcflz\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975090    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975120    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-slash\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975138    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysconfig\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975196    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975224    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-cni-binary-copy\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975258    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-k8s-cni-cncf-io\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975282    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-bin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975304    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-daemon-config\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975333    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975359    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c3628a-ed78-4b82-aa08-fd60e372fec9-host-slash\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975381    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-systemd-units\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975427    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-systemd\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975449    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-var-lib-kubelet\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975464    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975472    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-socket-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975501    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975528    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-ovn\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975553    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gs4j\" (UniqueName: \"kubernetes.io/projected/5d13926e-bdb5-457f-919a-5557417a65ad-kube-api-access-4gs4j\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975572    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-multus\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975589    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 16:15:45.975955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-multus-certs\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975634    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-hosts-file\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975655    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-tmp-dir\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975683    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-netd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-modprobe-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975736    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-kubernetes\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975760    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-conf\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975788    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975810    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-node-log\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975829    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-bin\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-config\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975873    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-sys-fs\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975894    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-conf-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975918    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0c50fd8-df66-4e5e-9c48-7439edc9682f-host\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975942    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c3628a-ed78-4b82-aa08-fd60e372fec9-iptables-alerter-script\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975959    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-script-lib\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.975988    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-etc-kubernetes\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.976610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976031    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-lib-modules\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976038    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d0c50fd8-df66-4e5e-9c48-7439edc9682f-host\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976087    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-tuned\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976115    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-registration-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976139    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-device-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976169    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0c50fd8-df66-4e5e-9c48-7439edc9682f-serviceca\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976190    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-netns\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976211    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-log-socket\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976233    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-env-overrides\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976262    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976302    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976327    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-hostroot\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:45.977238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.976938    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d0c50fd8-df66-4e5e-9c48-7439edc9682f-serviceca\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:45.979538 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.979522    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cd11577e-bdc6-4c35-bb44-fdb1b05b63e9-agent-certs\") pod \"konnectivity-agent-s7rn9\" (UID: \"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9\") " pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:45.990819 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.990796    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzw4\" (UniqueName: \"kubernetes.io/projected/fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4-kube-api-access-bqzw4\") pod \"multus-additional-cni-plugins-hc9z7\" (UID: \"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4\") " pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:45.991158 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:45.991137    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88llk\" (UniqueName: \"kubernetes.io/projected/d0c50fd8-df66-4e5e-9c48-7439edc9682f-kube-api-access-88llk\") pod \"node-ca-xqgrq\" (UID: \"d0c50fd8-df66-4e5e-9c48-7439edc9682f\") " pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:46.001206 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.001166    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal" event={"ID":"59460863c4fbb5924e4682eca1466157","Type":"ContainerStarted","Data":"7f54e4d84f2bdadaf3f8ca6e107f8ea166e0e2ab46824bca71b021bed307c66d"}
Sep 18 16:15:46.002416 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.002386    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal" event={"ID":"64e53398dbf928ecaca3a4fe5d4a5d05","Type":"ContainerStarted","Data":"f70f7759c649efbafadb9d2bd7629f337ab7769a7fd0f8fe7333a9f71e42d68c"}
Sep 18 16:15:46.077044 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077018    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-run\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077212 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077051    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-sys\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077212 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077075    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ln2\" (UniqueName: \"kubernetes.io/projected/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kube-api-access-45ln2\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.077368 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077096    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcflz\" (UniqueName: \"kubernetes.io/projected/7d77dd56-a175-4a39-8314-155bb5e40fa6-kube-api-access-bcflz\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077437 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077395    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-slash\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.077437 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077422    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysconfig\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077159    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-run\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077173    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-sys\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077445    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077454    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-slash\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077496    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysconfig\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-cni-binary-copy\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077525    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077540    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-k8s-cni-cncf-io\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077559    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-bin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077585    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-daemon-config\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077613    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c3628a-ed78-4b82-aa08-fd60e372fec9-host-slash\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077617    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-k8s-cni-cncf-io\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-systemd-units\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077652    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077652    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-bin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077668    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-systemd\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077671    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c3628a-ed78-4b82-aa08-fd60e372fec9-host-slash\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077682    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-var-lib-kubelet\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077705    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-systemd-units\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077720    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-socket-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077746    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077729    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-var-lib-kubelet\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077761    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-systemd\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077772    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-ovn\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.077969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077796    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gs4j\" (UniqueName: \"kubernetes.io/projected/5d13926e-bdb5-457f-919a-5557417a65ad-kube-api-access-4gs4j\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077841    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-multus\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077843    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077845    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-socket-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077900    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-ovn\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077954    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-multus-certs\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.077999    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-hosts-file\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078004    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-cni-multus\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-tmp-dir\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078057    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-netd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078074    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-hosts-file\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078082    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-modprobe-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078059    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-multus-certs\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078110    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-cni-binary-copy\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078121    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-netd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078123    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-kubernetes\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078158    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-conf\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.078742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078182    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078191    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-daemon-config\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078208    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-node-log\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078221    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-modprobe-d\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078228    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078234    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-bin\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078264    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-config\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078230    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-kubernetes\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078270    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-cni-bin\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078268    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-node-log\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078291    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-sys-fs\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-sysctl-conf\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078324    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-conf-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078332    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-tmp-dir\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078339    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-sys-fs\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078356    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c3628a-ed78-4b82-aa08-fd60e372fec9-iptables-alerter-script\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078363    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-conf-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078382    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-script-lib\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.079578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078404    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-etc-kubernetes\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078419    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-lib-modules\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078440    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-tuned\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078464    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-registration-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078465    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-etc-kubernetes\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078499    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-device-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-netns\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078541    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-lib-modules\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078548    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-log-socket\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078579    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-log-socket\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-env-overrides\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078625    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-device-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078641    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078661    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-netns\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-hostroot\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078695    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwg99\" (UniqueName: \"kubernetes.io/projected/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-kube-api-access-lwg99\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.080340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078699    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-hostroot\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078721    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw289\" (UniqueName: \"kubernetes.io/projected/a86ddc9e-bec5-4042-bf08-ea934285eedb-kube-api-access-zw289\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078763    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovn-node-metrics-cert\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078786    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-config\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078788    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078832    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-socket-dir-parent\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078863    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-var-lib-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078889    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c3628a-ed78-4b82-aa08-fd60e372fec9-iptables-alerter-script\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078892    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-system-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078936    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-system-cni-dir\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-netns\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078988    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-kubelet\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079023    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5d2c\" (UniqueName: \"kubernetes.io/projected/c0c3628a-ed78-4b82-aa08-fd60e372fec9-kube-api-access-s5d2c\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079029    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovnkube-script-lib\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079048    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s56x\" (UniqueName: \"kubernetes.io/projected/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-kube-api-access-2s56x\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079073    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-kubelet\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079076    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-env-overrides\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079096    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-host\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079123    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-systemd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079127    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079147    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079171    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-tmp\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079180    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079246    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-var-lib-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079247    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-cnibin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079283    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-cnibin\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079288    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-etc-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.079347    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079352    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-etc-openvswitch\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079382    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-var-lib-kubelet\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.079396    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.579379764 +0000 UTC m=+3.070336211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079399    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-multus-socket-dir-parent\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.078971    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d77dd56-a175-4a39-8314-155bb5e40fa6-host-run-netns\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.081812 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079433    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-kubelet\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079442    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-run-systemd\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079480    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a86ddc9e-bec5-4042-bf08-ea934285eedb-host\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079488    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d1cac45-ed23-45b9-95a9-d303e781e2f3-registration-dir\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.079528    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.081706    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-etc-tuned\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.081753    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86ddc9e-bec5-4042-bf08-ea934285eedb-tmp\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.082520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.081779    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-ovn-node-metrics-cert\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.088568 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.088495    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:15:46.088568 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.088518    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:15:46.088568 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.088531    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:46.088914 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.088596    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.588579614 +0000 UTC m=+3.079536059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:46.090287 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.090236    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5d2c\" (UniqueName: \"kubernetes.io/projected/c0c3628a-ed78-4b82-aa08-fd60e372fec9-kube-api-access-s5d2c\") pod \"iptables-alerter-zbhmz\" (UID: \"c0c3628a-ed78-4b82-aa08-fd60e372fec9\") " pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.090670 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.090651    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ln2\" (UniqueName: \"kubernetes.io/projected/9d1cac45-ed23-45b9-95a9-d303e781e2f3-kube-api-access-45ln2\") pod \"aws-ebs-csi-driver-node-vnmvf\" (UID: \"9d1cac45-ed23-45b9-95a9-d303e781e2f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.090768 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.090736    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gs4j\" (UniqueName: \"kubernetes.io/projected/5d13926e-bdb5-457f-919a-5557417a65ad-kube-api-access-4gs4j\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:46.091582 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.091514    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcflz\" (UniqueName: \"kubernetes.io/projected/7d77dd56-a175-4a39-8314-155bb5e40fa6-kube-api-access-bcflz\") pod \"multus-6bhgj\" (UID: \"7d77dd56-a175-4a39-8314-155bb5e40fa6\") " pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.091793 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.091764    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s56x\" (UniqueName: \"kubernetes.io/projected/953c47d7-17b9-4d8f-8cf5-eabab7a756b8-kube-api-access-2s56x\") pod \"node-resolver-z2pp9\" (UID: \"953c47d7-17b9-4d8f-8cf5-eabab7a756b8\") " pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.092060 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.092033    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwg99\" (UniqueName: \"kubernetes.io/projected/ef0df92f-67c0-430e-ba0f-922dd4e6fefc-kube-api-access-lwg99\") pod \"ovnkube-node-xmk47\" (UID: \"ef0df92f-67c0-430e-ba0f-922dd4e6fefc\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.092206 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.092192    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw289\" (UniqueName: \"kubernetes.io/projected/a86ddc9e-bec5-4042-bf08-ea934285eedb-kube-api-access-zw289\") pod \"tuned-l26z5\" (UID: \"a86ddc9e-bec5-4042-bf08-ea934285eedb\") " pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.169922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.169894    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqgrq"
Sep 18 16:15:46.178459 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.178433    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hc9z7"
Sep 18 16:15:46.188122 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.188063    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:15:46.195648 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.195626    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zbhmz"
Sep 18 16:15:46.203254 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.203235    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2pp9"
Sep 18 16:15:46.210804 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.210781    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf"
Sep 18 16:15:46.218438 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.218421    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:15:46.226076 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.226052    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l26z5"
Sep 18 16:15:46.230625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.230605    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bhgj"
Sep 18 16:15:46.482273 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.482198    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:46.482437 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.482324    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:46.482437 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.482389    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.482370746 +0000 UTC m=+3.973327191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:46.582730 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.582700    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:46.582922 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.582806    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:46.582922 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.582859    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.582844692 +0000 UTC m=+4.073801121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:46.683354 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.683319    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:46.683530 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.683469    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:15:46.683530 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.683485    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:15:46.683530 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.683494    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:46.683664 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:46.683544    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.68352736 +0000 UTC m=+4.174483803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:46.944675 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.944485    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd11577e_bdc6_4c35_bb44_fdb1b05b63e9.slice/crio-5075b4da21c2551c2f2c555560a657ba83dfaeb4ab9a083831947015b4649167 WatchSource:0}: Error finding container 5075b4da21c2551c2f2c555560a657ba83dfaeb4ab9a083831947015b4649167: Status 404 returned error can't find the container with id 5075b4da21c2551c2f2c555560a657ba83dfaeb4ab9a083831947015b4649167
Sep 18 16:15:46.945013 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.944709    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:10:45 +0000 UTC" deadline="2028-04-10 16:50:23.116755145 +0000 UTC"
Sep 18 16:15:46.945013 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:46.944742    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13680h34m36.172014992s"
Sep 18 16:15:46.945947 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.945849    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c3628a_ed78_4b82_aa08_fd60e372fec9.slice/crio-d61679d5d5e15bac75efa3fddfee713143118f51456cebaebb979cbc6d9ce918 WatchSource:0}: Error finding container d61679d5d5e15bac75efa3fddfee713143118f51456cebaebb979cbc6d9ce918: Status 404 returned error can't find the container with id d61679d5d5e15bac75efa3fddfee713143118f51456cebaebb979cbc6d9ce918
Sep 18 16:15:46.949826 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.949807    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953c47d7_17b9_4d8f_8cf5_eabab7a756b8.slice/crio-56f36be4971cc1b9ec9bb22ba5f50af8441b9277e3df10dd4ed477efb384fa80 WatchSource:0}: Error finding container 56f36be4971cc1b9ec9bb22ba5f50af8441b9277e3df10dd4ed477efb384fa80: Status 404 returned error can't find the container with id 56f36be4971cc1b9ec9bb22ba5f50af8441b9277e3df10dd4ed477efb384fa80
Sep 18 16:15:46.950859 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.950838    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d77dd56_a175_4a39_8314_155bb5e40fa6.slice/crio-ac7d6a372b2c3d6ec27378c93b3db4235044c28d8fd7038c8505e39c4e57166f WatchSource:0}: Error finding container ac7d6a372b2c3d6ec27378c93b3db4235044c28d8fd7038c8505e39c4e57166f: Status 404 returned error can't find the container with id ac7d6a372b2c3d6ec27378c93b3db4235044c28d8fd7038c8505e39c4e57166f
Sep 18 16:15:46.951867 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.951843    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1cac45_ed23_45b9_95a9_d303e781e2f3.slice/crio-6f979449e44043a9233ba04079deb383f4e9af96ec40d74db369ee9bd41b79d5 WatchSource:0}: Error finding container 6f979449e44043a9233ba04079deb383f4e9af96ec40d74db369ee9bd41b79d5: Status 404 returned error can't find the container with id 6f979449e44043a9233ba04079deb383f4e9af96ec40d74db369ee9bd41b79d5
Sep 18 16:15:46.953917 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.952491    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c50fd8_df66_4e5e_9c48_7439edc9682f.slice/crio-f13137ceda5846e47a973dfafb8f61bf3da172808aaf05074643a38ca66ff4fe WatchSource:0}: Error finding container f13137ceda5846e47a973dfafb8f61bf3da172808aaf05074643a38ca66ff4fe: Status 404 returned error can't find the container with id f13137ceda5846e47a973dfafb8f61bf3da172808aaf05074643a38ca66ff4fe
Sep 18 16:15:46.953917 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.953606    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0c37e1_3e38_4aa5_bdc8_818eeac4fbb4.slice/crio-dc80cfbf40433ce196e9b5110a189238d65b04577c20b4d02a4ab140e1c1631a WatchSource:0}: Error finding container dc80cfbf40433ce196e9b5110a189238d65b04577c20b4d02a4ab140e1c1631a: Status 404 returned error can't find the container with id dc80cfbf40433ce196e9b5110a189238d65b04577c20b4d02a4ab140e1c1631a
Sep 18 16:15:46.954403 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.954226    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86ddc9e_bec5_4042_bf08_ea934285eedb.slice/crio-16a03f3b8a933cbde6e79451f168905043d19e960ba328ac5a7bb05a2ac258f6 WatchSource:0}: Error finding container 16a03f3b8a933cbde6e79451f168905043d19e960ba328ac5a7bb05a2ac258f6: Status 404 returned error can't find the container with id 16a03f3b8a933cbde6e79451f168905043d19e960ba328ac5a7bb05a2ac258f6
Sep 18 16:15:46.955929 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:15:46.955214    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0df92f_67c0_430e_ba0f_922dd4e6fefc.slice/crio-ac4665e6308612b1fd56e7e6e51ff27b9830e35d956dd289a08414f42b33f862 WatchSource:0}: Error finding container ac4665e6308612b1fd56e7e6e51ff27b9830e35d956dd289a08414f42b33f862: Status 404 returned error can't find the container with id ac4665e6308612b1fd56e7e6e51ff27b9830e35d956dd289a08414f42b33f862
Sep 18 16:15:47.005554 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.005519    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"ac4665e6308612b1fd56e7e6e51ff27b9830e35d956dd289a08414f42b33f862"}
Sep 18 16:15:47.006849 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.006812    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l26z5" event={"ID":"a86ddc9e-bec5-4042-bf08-ea934285eedb","Type":"ContainerStarted","Data":"16a03f3b8a933cbde6e79451f168905043d19e960ba328ac5a7bb05a2ac258f6"}
Sep 18 16:15:47.008025 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.008001    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerStarted","Data":"dc80cfbf40433ce196e9b5110a189238d65b04577c20b4d02a4ab140e1c1631a"}
Sep 18 16:15:47.009484 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.009463    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqgrq" event={"ID":"d0c50fd8-df66-4e5e-9c48-7439edc9682f","Type":"ContainerStarted","Data":"f13137ceda5846e47a973dfafb8f61bf3da172808aaf05074643a38ca66ff4fe"}
Sep 18 16:15:47.011539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.011419    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2pp9" event={"ID":"953c47d7-17b9-4d8f-8cf5-eabab7a756b8","Type":"ContainerStarted","Data":"56f36be4971cc1b9ec9bb22ba5f50af8441b9277e3df10dd4ed477efb384fa80"}
Sep 18 16:15:47.012568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.012545    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zbhmz" event={"ID":"c0c3628a-ed78-4b82-aa08-fd60e372fec9","Type":"ContainerStarted","Data":"d61679d5d5e15bac75efa3fddfee713143118f51456cebaebb979cbc6d9ce918"}
Sep 18 16:15:47.013728 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.013706    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf" event={"ID":"9d1cac45-ed23-45b9-95a9-d303e781e2f3","Type":"ContainerStarted","Data":"6f979449e44043a9233ba04079deb383f4e9af96ec40d74db369ee9bd41b79d5"}
Sep 18 16:15:47.014852 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.014825    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bhgj" event={"ID":"7d77dd56-a175-4a39-8314-155bb5e40fa6","Type":"ContainerStarted","Data":"ac7d6a372b2c3d6ec27378c93b3db4235044c28d8fd7038c8505e39c4e57166f"}
Sep 18 16:15:47.015922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.015902    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s7rn9" event={"ID":"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9","Type":"ContainerStarted","Data":"5075b4da21c2551c2f2c555560a657ba83dfaeb4ab9a083831947015b4649167"}
Sep 18 16:15:47.490065 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.489961    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:47.490232 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.490179    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:47.490292 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.490245    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.490218785 +0000 UTC m=+5.981175233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:47.590738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.590682    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:47.590934 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.590830    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:47.590934 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.590896    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.590876924 +0000 UTC m=+6.081833360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:47.691344 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.691305    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:47.691526 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.691513    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:15:47.691589 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.691536    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:15:47.691589 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.691549    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:47.691720 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.691608    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.691589088 +0000 UTC m=+6.182545533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:47.745077 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.744768    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 16:15:47.945316 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.945251    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:10:45 +0000 UTC" deadline="2028-02-27 05:16:41.77863289 +0000 UTC"
Sep 18 16:15:47.945316 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.945285    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12637h0m53.833352219s"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.994851    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.994859    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.995155    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.995005    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:47.995008    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:47.995387 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:47.995249    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:48.044841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:48.044801    2552 generic.go:356] "Generic (PLEG): container finished" podID="59460863c4fbb5924e4682eca1466157" containerID="722bd2cadb85bffdcdd7777ac5525c47592af5bd406e3809fa911ecf89bc0701" exitCode=0
Sep 18 16:15:48.045005 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:48.044911    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal" event={"ID":"59460863c4fbb5924e4682eca1466157","Type":"ContainerDied","Data":"722bd2cadb85bffdcdd7777ac5525c47592af5bd406e3809fa911ecf89bc0701"}
Sep 18 16:15:48.055389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:48.054702    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal" event={"ID":"64e53398dbf928ecaca3a4fe5d4a5d05","Type":"ContainerStarted","Data":"c324791692a5b52368db76ef9f653364d677cac55e856a553eec89af4d003e11"}
Sep 18 16:15:49.071586 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.071505    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal" event={"ID":"59460863c4fbb5924e4682eca1466157","Type":"ContainerStarted","Data":"a38c7c911e233a987b4854944117ab0bb16a6965258154c609e11e40e555b11d"}
Sep 18 16:15:49.087634 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.087576    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-224.ec2.internal" podStartSLOduration=4.087555802 podStartE2EDuration="4.087555802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:15:48.08160594 +0000 UTC m=+4.572562392" watchObservedRunningTime="2026-09-18 16:15:49.087555802 +0000 UTC m=+5.578512254"
Sep 18 16:15:49.506368 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.506287    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:49.506527 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.506478    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:49.506590 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.506539    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.506522189 +0000 UTC m=+9.997478625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:49.607266 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.607227    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:49.607462 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.607397    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:49.607542 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.607464    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.607443971 +0000 UTC m=+10.098400426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:49.708588 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.708524    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:49.708770 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.708686    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:15:49.708770 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.708705    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:15:49.708770 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.708718    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:49.708939 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.708783    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.708765765 +0000 UTC m=+10.199722200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:49.995530 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.995440    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:49.995705 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.995440    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:49.995705 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.995594    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:49.995910 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.995716    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:49.995910 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:49.995440    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:49.995910 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:49.995817    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:51.995132 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:51.995098    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:51.995722 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:51.995229    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:51.995722 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:51.995653    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:51.995899 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:51.995744    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:51.995899 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:51.995879    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:51.996050 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:51.995970    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:53.545923 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.545807    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:53.546399 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.545996    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:53.546399 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.546068    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.546047379 +0000 UTC m=+18.037003823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:15:53.646599 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.646555    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:53.646765 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.646727    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:53.646838 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.646801    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.646779855 +0000 UTC m=+18.137736300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:15:53.747735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.747691    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:53.747921 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.747896    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:15:53.748021 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.747927    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:15:53.748021 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.747943    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:53.748021 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.748020    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.748000573 +0000 UTC m=+18.238957018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:15:53.996250 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.996113    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:53.996250 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.996209    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:53.996455 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.996293    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:53.996455 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.996338    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:53.996455 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:53.996376    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:53.996615 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:53.996453    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:55.995379 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:55.995340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:55.995847 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:55.995340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:55.995847 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:55.995340    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:55.995847 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:55.995544    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:55.995847 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:55.995591    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:55.995847 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:55.995497    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:57.995308 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:57.995267    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:57.995308 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:57.995300    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:57.995774 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:57.995267    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:57.995774 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:57.995386    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:15:57.995774 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:57.995438    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:57.995774 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:57.995492    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:59.994725 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:59.994685    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:15:59.995248 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:59.994737    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:15:59.995248 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:15:59.994685    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:15:59.995248 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:59.994826    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:15:59.995248 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:59.994901    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:15:59.995248 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:15:59.994988    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:01.606033 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.605992    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:01.606504 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.606147    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:16:01.606504 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.606225    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.606206887 +0000 UTC m=+34.097163328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:16:01.706533 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.706495    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:01.706737 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.706654    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:16:01.706737 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.706723    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.706704619 +0000 UTC m=+34.197661068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:16:01.807792 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.807753    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:01.807970 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.807948    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:16:01.807970 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.807970    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:16:01.808088 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.807995    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:16:01.808088 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.808069    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.808039134 +0000 UTC m=+34.298995563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:16:01.995208 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.995125    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:01.995208 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.995157    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:01.995420 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:01.995125    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:01.995420 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.995254    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:01.995420 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.995344    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:01.995538 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:01.995428    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:03.996225 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:03.996195    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:03.996653 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:03.996300    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:03.996653 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:03.996291    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:03.996653 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:03.996422    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:03.996653 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:03.996446    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:03.996653 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:03.996549    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:05.102844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.102658    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l26z5" event={"ID":"a86ddc9e-bec5-4042-bf08-ea934285eedb","Type":"ContainerStarted","Data":"3545461a771a0eda21142e22391d2a4f1a1c6fc65f96669797f3e6f96cf10714"}
Sep 18 16:16:05.104147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.104124    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="9659b2eeeddf27de368231fd70c5accfef4f7437c5b682b527fd07d6dca07dad" exitCode=0
Sep 18 16:16:05.104245 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.104202    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"9659b2eeeddf27de368231fd70c5accfef4f7437c5b682b527fd07d6dca07dad"}
Sep 18 16:16:05.105702 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.105682    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqgrq" event={"ID":"d0c50fd8-df66-4e5e-9c48-7439edc9682f","Type":"ContainerStarted","Data":"9f4b1b833063c4bf76ce6374bcfbd09c4fde549db04c9b317f01546586a28324"}
Sep 18 16:16:05.107183 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.107163    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2pp9" event={"ID":"953c47d7-17b9-4d8f-8cf5-eabab7a756b8","Type":"ContainerStarted","Data":"e3c8fa65afa86f44f345168dc57c223eb7b64b5cf47ef1223347edcbbc305804"}
Sep 18 16:16:05.108728 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.108566    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf" event={"ID":"9d1cac45-ed23-45b9-95a9-d303e781e2f3","Type":"ContainerStarted","Data":"de0ed4fd6126eff105e9b3006f6fdea00ffaf70ca17ad1ab2dbc3ade5e0e890f"}
Sep 18 16:16:05.110198 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.110171    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bhgj" event={"ID":"7d77dd56-a175-4a39-8314-155bb5e40fa6","Type":"ContainerStarted","Data":"92a7fda9ccc6fb99611b5d0f15a3ecb18f441edae62aad661fcb6179f12e8d44"}
Sep 18 16:16:05.112038 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.112006    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s7rn9" event={"ID":"cd11577e-bdc6-4c35-bb44-fdb1b05b63e9","Type":"ContainerStarted","Data":"ac75238b782d2a5b356e6fa68ea435b002144494972f08723decc087ade0f47e"}
Sep 18 16:16:05.114435 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114418    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:16:05.114773 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114753    2552 generic.go:356] "Generic (PLEG): container finished" podID="ef0df92f-67c0-430e-ba0f-922dd4e6fefc" containerID="710be4119d211271a4b0d76424b6b8c3288977f07de20f98b2abb6b7d2b93619" exitCode=1
Sep 18 16:16:05.114844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114780    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"f0bb980c8e4428d01d380253d73e21feb8cea8b38ab281ac6a56e7cdfbfc59ac"}
Sep 18 16:16:05.114844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114830    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"3df535c9926ed5e14d841f6338872cf3512894e3b0e2e26d90ddf69bb22ba969"}
Sep 18 16:16:05.114924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114859    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"a15663bbfdb5e78543eb4e8dda8c8d1b340887e0b29680faad14daaff4c9f3b2"}
Sep 18 16:16:05.114924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerDied","Data":"710be4119d211271a4b0d76424b6b8c3288977f07de20f98b2abb6b7d2b93619"}
Sep 18 16:16:05.114924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.114915    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"7a27e4727a5ec11d801894ca0a4d8e0c0ab5fa593242e9fb29f517dfc1461395"}
Sep 18 16:16:05.128062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.128008    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-224.ec2.internal" podStartSLOduration=20.127990898 podStartE2EDuration="20.127990898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:15:49.088219425 +0000 UTC m=+5.579175877" watchObservedRunningTime="2026-09-18 16:16:05.127990898 +0000 UTC m=+21.618947347"
Sep 18 16:16:05.156384 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.156344    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s7rn9" podStartSLOduration=3.675635499 podStartE2EDuration="21.156331071s" totalImagesPullingTime="17.480695572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.140846034 +0000 UTC m=+21.631802484" watchObservedRunningTime="2026-09-18 16:16:05.156331071 +0000 UTC m=+21.647287521"
Sep 18 16:16:05.156490 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.156465    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z2pp9" podStartSLOduration=3.663279311 podStartE2EDuration="21.156454597s" totalImagesPullingTime="17.493175286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.155872559 +0000 UTC m=+21.646829011" watchObservedRunningTime="2026-09-18 16:16:05.156454597 +0000 UTC m=+21.647411052"
Sep 18 16:16:05.179864 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.179827    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l26z5" podStartSLOduration=3.629210496 podStartE2EDuration="21.179813936s" totalImagesPullingTime="17.55060344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.17956774 +0000 UTC m=+21.670524191" watchObservedRunningTime="2026-09-18 16:16:05.179813936 +0000 UTC m=+21.670770386"
Sep 18 16:16:05.206067 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.205968    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6bhgj" podStartSLOduration=3.414212051 podStartE2EDuration="21.205953462s" totalImagesPullingTime="17.791741411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.205779656 +0000 UTC m=+21.696736107" watchObservedRunningTime="2026-09-18 16:16:05.205953462 +0000 UTC m=+21.696909927"
Sep 18 16:16:05.226949 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.226908    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqgrq" podStartSLOduration=3.674660197 podStartE2EDuration="21.226896351s" totalImagesPullingTime="17.552236154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.226483149 +0000 UTC m=+21.717439607" watchObservedRunningTime="2026-09-18 16:16:05.226896351 +0000 UTC m=+21.717852802"
Sep 18 16:16:05.995374 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.995299    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:05.995627 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.995299    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:05.995627 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:05.995432    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:05.995627 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:05.995522    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:05.995627 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:05.995303    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:05.995627 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:05.995620    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:06.119722 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.119695    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:16:06.120162 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.120141    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"a4406c80d7bdb1d4b09ba7f6f39deb6d0e9bf6c5f029bda7e8300a27289673d9"}
Sep 18 16:16:06.121677 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.121651    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zbhmz" event={"ID":"c0c3628a-ed78-4b82-aa08-fd60e372fec9","Type":"ContainerStarted","Data":"40eb78633b1225386c20758cc92483ae39c6111129218e8f5e32231bb3f65411"}
Sep 18 16:16:06.140526 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.140402    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zbhmz" podStartSLOduration=4.582429075 podStartE2EDuration="22.140384064s" totalImagesPullingTime="17.557954989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:06.139840571 +0000 UTC m=+22.630797021" watchObservedRunningTime="2026-09-18 16:16:06.140384064 +0000 UTC m=+22.631340515"
Sep 18 16:16:06.236102 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.236075    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 16:16:06.291400 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.291293    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:16:06.291969 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.291945    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:16:06.925958 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.925666    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T16:16:06.236096044Z","UUID":"5185aca9-cfcb-44df-a7ee-f70f24dc6239","Handler":null,"Name":"","Endpoint":""}
Sep 18 16:16:06.927820 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.927798    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 16:16:06.928075 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:06.927835    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 16:16:07.126960 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:07.126917    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf" event={"ID":"9d1cac45-ed23-45b9-95a9-d303e781e2f3","Type":"ContainerStarted","Data":"bab06541ac99fe238c720665555e91db384d1e1fc492fad6e0b4f90596f5a04a"}
Sep 18 16:16:07.995126 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:07.995042    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:07.995275 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:07.995041    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:07.995275 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:07.995167    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:07.995275 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:07.995229    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:07.995275 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:07.995049    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:07.995475 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:07.995308    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:08.131932 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.131889    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf" event={"ID":"9d1cac45-ed23-45b9-95a9-d303e781e2f3","Type":"ContainerStarted","Data":"d1a0ed554b82d1f21efdb15f90635f8b7b0113cf815aebf59501b3a3302faafb"}
Sep 18 16:16:08.135954 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.135930    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:16:08.136387 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.136366    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 16:16:08.136491 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.136370    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"b5bcde7985f7fd8742b0b279d2b659170c0b2b7278213c8b78fdab7573e60571"}
Sep 18 16:16:08.151124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.151076    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vnmvf" podStartSLOduration=3.878671622 podStartE2EDuration="24.151058357s" totalImagesPullingTime="20.272386735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:08.150867824 +0000 UTC m=+24.641824275" watchObservedRunningTime="2026-09-18 16:16:08.151058357 +0000 UTC m=+24.642014808"
Sep 18 16:16:08.546528 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.546472    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:08.668580 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:08.668535    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:09.994930 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:09.994758    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:09.995464 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:09.994764    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:09.995464 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:09.995043    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:09.995464 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:09.994765    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:09.995464 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:09.995123    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:09.995464 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:09.995185    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:10.144713 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.144687    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:16:10.145076 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.145055    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"8edfe041ddb75300186482e2e17f5c638f6c2682e01825e3cf0a2116c978daaa"}
Sep 18 16:16:10.145301 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.145284    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:10.145520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.145500    2552 scope.go:117] "RemoveContainer" containerID="710be4119d211271a4b0d76424b6b8c3288977f07de20f98b2abb6b7d2b93619"
Sep 18 16:16:10.147075 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.147049    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="dd7119bab3c53b8163f2cedec56513041511dbcb2398b0f8d39be2261e522329" exitCode=0
Sep 18 16:16:10.147172 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.147096    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"dd7119bab3c53b8163f2cedec56513041511dbcb2398b0f8d39be2261e522329"}
Sep 18 16:16:10.160394 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.160374    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:10.790955 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.790918    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:10.863330 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.863298    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:10.942786 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:10.942746    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:11.021626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.021594    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:11.155058 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.155027    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:16:11.155530 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.155495    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" event={"ID":"ef0df92f-67c0-430e-ba0f-922dd4e6fefc","Type":"ContainerStarted","Data":"4913184ca006ab5afd481e5d901f96b11f8f9aa948fb382146e024a264a3574a"}
Sep 18 16:16:11.156817 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.156790    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:11.156922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.156884    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:11.160560 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.160527    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="63a65474c9bda472ca4a8505e351898b6875f5e68a75cf0b4d033188abeb0240" exitCode=0
Sep 18 16:16:11.160679 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.160594    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"63a65474c9bda472ca4a8505e351898b6875f5e68a75cf0b4d033188abeb0240"}
Sep 18 16:16:11.175566 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.175540    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:11.189039 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.188988    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47" podStartSLOduration=9.602009159 podStartE2EDuration="27.188958941s" totalImagesPullingTime="17.586949782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:11.187665802 +0000 UTC m=+27.678622255" watchObservedRunningTime="2026-09-18 16:16:11.188958941 +0000 UTC m=+27.679915391"
Sep 18 16:16:11.754819 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.754547    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dqnn7"]
Sep 18 16:16:11.755075 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.754916    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:11.755075 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:11.755024    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:11.758095 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.758071    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ch6l6"]
Sep 18 16:16:11.758225 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.758185    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:11.758310 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:11.758283    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:11.758663 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.758644    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9m57n"]
Sep 18 16:16:11.758761 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:11.758748    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:11.758866 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:11.758850    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:12.165384 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:12.165291    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="9d8dd6e3ea5b3a64ffe9939015a30ab3dbd5a59bf5a5c02505d3f3c0cdc34c25" exitCode=0
Sep 18 16:16:12.165808 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:12.165383    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"9d8dd6e3ea5b3a64ffe9939015a30ab3dbd5a59bf5a5c02505d3f3c0cdc34c25"}
Sep 18 16:16:12.715178 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:12.715066    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:12.781916 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:12.781881    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:12.995677 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:12.995597    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:12.995849 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:12.995748    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:13.001619 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.001580    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:13.102085 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.102052    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:13.899707 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.899620    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:16:13.900168 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.899790    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 16:16:13.900637 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.900617    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s7rn9"
Sep 18 16:16:13.962747 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.962717    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:13.996681 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.996647    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:13.996853 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:13.996757    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:13.996853 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:13.996803    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:13.996964 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:13.996886    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:14.062830 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:14.062798    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log" limit=1024
Sep 18 16:16:14.995149 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:14.995112    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:14.995726 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:14.995264    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:15.995270 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:15.995182    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:15.995270 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:15.995182    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:15.995760 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:15.995323    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ch6l6" podUID="611a5dfd-7899-4ad7-8729-4def26a816b1"
Sep 18 16:16:15.995760 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:15.995373    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dqnn7" podUID="7a497cea-5563-452c-a622-16becb8a0134"
Sep 18 16:16:16.995621 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:16.995582    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:16.996066 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:16.995688    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9m57n" podUID="5d13926e-bdb5-457f-919a-5557417a65ad"
Sep 18 16:16:17.295025 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.294994    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-224.ec2.internal" event="NodeReady"
Sep 18 16:16:17.295163 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.295149    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 16:16:17.330149 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.329887    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:16:17.350640 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.350612    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qq425"]
Sep 18 16:16:17.350789 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.350769    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.355735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.355713    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 16:16:17.355993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.355957    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 16:16:17.356116 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.356049    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 16:16:17.356567 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.356552    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h482k\""
Sep 18 16:16:17.362922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.362904    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 16:16:17.365138 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.364814    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rvt2x"]
Sep 18 16:16:17.365138 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.365029    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.371922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.368387    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 16:16:17.371922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.368787    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 16:16:17.371922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.368784    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-44fnz\""
Sep 18 16:16:17.380719 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.380693    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:16:17.380839 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.380734    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq425"]
Sep 18 16:16:17.380839 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.380760    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvt2x"]
Sep 18 16:16:17.380839 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.380806    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.383755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.383730    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 16:16:17.383887 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.383756    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 16:16:17.383950 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.383910    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 16:16:17.384034 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.383910    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nst46\""
Sep 18 16:16:17.421916 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.421871    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.421946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.421997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.422028    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.422059    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jx8\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422124 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.422099    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422320 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.422129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.422320 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.422205    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523199 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523117    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523199 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523157    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523199 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523173    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523218    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-config-volume\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523254    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jx8\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.523273    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.523292    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g: secret "image-registry-tls" not found
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.523345    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls podName:e6894d71-bf19-4524-b54e-49a1b395c98c nodeName:}" failed. No retries permitted until 2026-09-18 16:16:18.02332799 +0000 UTC m=+34.514284419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls") pod "image-registry-6fdfd6b8d8-gtn9g" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c") : secret "image-registry-tls" not found
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523276    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-tmp-dir\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.523424 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nkj\" (UniqueName: \"kubernetes.io/projected/830cc37b-b3f1-4537-81ac-76d8f6abbf19-kube-api-access-v5nkj\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523439    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523557    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523659    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523702    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.523755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523726    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbjjm\" (UniqueName: \"kubernetes.io/projected/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-kube-api-access-xbjjm\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.523999 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830cc37b-b3f1-4537-81ac-76d8f6abbf19-cert\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.523999 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.523830    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.524172 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.524151    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.524545 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.524528    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.527157 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.527127    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.527258 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.527183    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.534064 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.534042    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.534161 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.534146    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jx8\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:17.624299 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624263    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-tmp-dir\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.624299 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624306    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nkj\" (UniqueName: \"kubernetes.io/projected/830cc37b-b3f1-4537-81ac-76d8f6abbf19-kube-api-access-v5nkj\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.624512 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624433    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:17.624512 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624496    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.624597 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624525    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbjjm\" (UniqueName: \"kubernetes.io/projected/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-kube-api-access-xbjjm\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.624597 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.624548    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 16:16:17.624597 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624575    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830cc37b-b3f1-4537-81ac-76d8f6abbf19-cert\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.624735 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.624639    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret podName:7a497cea-5563-452c-a622-16becb8a0134 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.624619376 +0000 UTC m=+66.115575810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret") pod "global-pull-secret-syncer-dqnn7" (UID: "7a497cea-5563-452c-a622-16becb8a0134") : object "kube-system"/"original-pull-secret" not registered
Sep 18 16:16:17.624735 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.624653    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:16:17.624735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624667    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-config-volume\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.624735 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.624722    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls podName:0a0376ee-b526-4b8e-b7c0-0ad0b6c49029 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:18.124703284 +0000 UTC m=+34.615659744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls") pod "dns-default-qq425" (UID: "0a0376ee-b526-4b8e-b7c0-0ad0b6c49029") : secret "dns-default-metrics-tls" not found
Sep 18 16:16:17.624735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.624652    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-tmp-dir\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.625170 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.625153    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-config-volume\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.626818 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.626800    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/830cc37b-b3f1-4537-81ac-76d8f6abbf19-cert\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.632322 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.632302    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nkj\" (UniqueName: \"kubernetes.io/projected/830cc37b-b3f1-4537-81ac-76d8f6abbf19-kube-api-access-v5nkj\") pod \"ingress-canary-rvt2x\" (UID: \"830cc37b-b3f1-4537-81ac-76d8f6abbf19\") " pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.632520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.632502    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbjjm\" (UniqueName: \"kubernetes.io/projected/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-kube-api-access-xbjjm\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:17.689683 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.689647    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvt2x"
Sep 18 16:16:17.725912 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.725893    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:17.726085 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.726066    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:16:17.726153 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.726144    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs podName:5d13926e-bdb5-457f-919a-5557417a65ad nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.726129974 +0000 UTC m=+66.217086408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs") pod "network-metrics-daemon-9m57n" (UID: "5d13926e-bdb5-457f-919a-5557417a65ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 16:16:17.826449 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.826417    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:17.826598 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.826579    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 16:16:17.826648 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.826603    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 16:16:17.826648 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.826614    2552 projected.go:196] Error preparing data for projected volume kube-api-access-dfsrd for pod openshift-network-diagnostics/network-check-target-ch6l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:16:17.826751 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:17.826664    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd podName:611a5dfd-7899-4ad7-8729-4def26a816b1 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.82665037 +0000 UTC m=+66.317606799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfsrd" (UniqueName: "kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd") pod "network-check-target-ch6l6" (UID: "611a5dfd-7899-4ad7-8729-4def26a816b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 16:16:17.995301 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.995263    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:17.995459 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.995263    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:17.998322 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.998289    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 16:16:17.998961 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.998355    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:16:17.998961 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.998289    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42l89\""
Sep 18 16:16:17.998961 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:17.998291    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 16:16:18.028480 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.028453    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:18.028633 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:18.028614    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:16:18.028670 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:18.028635    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g: secret "image-registry-tls" not found
Sep 18 16:16:18.028700 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:18.028688    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls podName:e6894d71-bf19-4524-b54e-49a1b395c98c nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.028672233 +0000 UTC m=+35.519628662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls") pod "image-registry-6fdfd6b8d8-gtn9g" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c") : secret "image-registry-tls" not found
Sep 18 16:16:18.031384 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.031359    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvt2x"]
Sep 18 16:16:18.034326 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:18.034307    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830cc37b_b3f1_4537_81ac_76d8f6abbf19.slice/crio-b408af8089bed85ced9e9b1280eac3b9b8e46ef25d356565071b63e9540731c6 WatchSource:0}: Error finding container b408af8089bed85ced9e9b1280eac3b9b8e46ef25d356565071b63e9540731c6: Status 404 returned error can't find the container with id b408af8089bed85ced9e9b1280eac3b9b8e46ef25d356565071b63e9540731c6
Sep 18 16:16:18.129241 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.129146    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:18.129389 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:18.129295    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:16:18.129389 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:18.129359    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls podName:0a0376ee-b526-4b8e-b7c0-0ad0b6c49029 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.129343416 +0000 UTC m=+35.620299870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls") pod "dns-default-qq425" (UID: "0a0376ee-b526-4b8e-b7c0-0ad0b6c49029") : secret "dns-default-metrics-tls" not found
Sep 18 16:16:18.182028 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.181993    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvt2x" event={"ID":"830cc37b-b3f1-4537-81ac-76d8f6abbf19","Type":"ContainerStarted","Data":"b408af8089bed85ced9e9b1280eac3b9b8e46ef25d356565071b63e9540731c6"}
Sep 18 16:16:18.184717 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.184689    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="9b3d51d98b6f1f0eb8caff2b67fdf9bd90fc192e7eef3703bdcd5a35c8a26343" exitCode=0
Sep 18 16:16:18.184805 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.184736    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"9b3d51d98b6f1f0eb8caff2b67fdf9bd90fc192e7eef3703bdcd5a35c8a26343"}
Sep 18 16:16:18.995318 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.995286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:18.999321 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.999295    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:16:18.999727 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:18.999405    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8kmlw\""
Sep 18 16:16:19.036156 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.036121    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:19.036311 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.036292    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:16:19.036356 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.036315    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g: secret "image-registry-tls" not found
Sep 18 16:16:19.036400 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.036376    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls podName:e6894d71-bf19-4524-b54e-49a1b395c98c nodeName:}" failed. No retries permitted until 2026-09-18 16:16:21.036361016 +0000 UTC m=+37.527317467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls") pod "image-registry-6fdfd6b8d8-gtn9g" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c") : secret "image-registry-tls" not found
Sep 18 16:16:19.050153 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.050122    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n6t97"]
Sep 18 16:16:19.064644 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.064622    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.067703 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.067678    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 16:16:19.067958 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.067941    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 16:16:19.068097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.068023    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 16:16:19.068097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.068074    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pj9mb\""
Sep 18 16:16:19.068210 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.068123    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 16:16:19.070081 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.070052    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n6t97"]
Sep 18 16:16:19.137131 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137087    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-data-volume\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.137290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.137290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137174    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.137290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137203    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbcwz\" (UniqueName: \"kubernetes.io/projected/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-api-access-xbcwz\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.137472 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137290    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:19.137472 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.137371    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-crio-socket\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.137555 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.137468    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:16:19.137555 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.137536    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls podName:0a0376ee-b526-4b8e-b7c0-0ad0b6c49029 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:21.1375153 +0000 UTC m=+37.628471744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls") pod "dns-default-qq425" (UID: "0a0376ee-b526-4b8e-b7c0-0ad0b6c49029") : secret "dns-default-metrics-tls" not found
Sep 18 16:16:19.191187 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.191148    2552 generic.go:356] "Generic (PLEG): container finished" podID="fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4" containerID="2a8db4e6bb22cf5b77782f2eb58c9be810761d96265649b9f244eb9fca46135a" exitCode=0
Sep 18 16:16:19.191343 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.191198    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerDied","Data":"2a8db4e6bb22cf5b77782f2eb58c9be810761d96265649b9f244eb9fca46135a"}
Sep 18 16:16:19.238507 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238274    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-crio-socket\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.238678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238522    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-crio-socket\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.238678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238582    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-data-volume\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.238678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238601    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.238678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238634    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.238678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbcwz\" (UniqueName: \"kubernetes.io/projected/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-api-access-xbcwz\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.239110 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.238748    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:16:19.239110 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.238841    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.738821031 +0000 UTC m=+36.229777461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : configmap "kube-rbac-proxy" not found
Sep 18 16:16:19.239110 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.238864    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:19.239110 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.238896    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-data-volume\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.239110 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.238922    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.738905994 +0000 UTC m=+36.229862439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:19.249939 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.249851    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbcwz\" (UniqueName: \"kubernetes.io/projected/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-api-access-xbcwz\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.369935 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.369903    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"]
Sep 18 16:16:19.388474 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.388446    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"]
Sep 18 16:16:19.388605 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.388543    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"
Sep 18 16:16:19.391379 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.391356    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 16:16:19.391510 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.391359    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jphvl\""
Sep 18 16:16:19.391510 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.391384    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 16:16:19.541126 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.541051    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv87z\" (UniqueName: \"kubernetes.io/projected/280a0bb0-8236-4bd4-a355-78a62e69e05f-kube-api-access-fv87z\") pod \"migrator-76794cbd6c-fdmg8\" (UID: \"280a0bb0-8236-4bd4-a355-78a62e69e05f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"
Sep 18 16:16:19.642578 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.642539    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv87z\" (UniqueName: \"kubernetes.io/projected/280a0bb0-8236-4bd4-a355-78a62e69e05f-kube-api-access-fv87z\") pod \"migrator-76794cbd6c-fdmg8\" (UID: \"280a0bb0-8236-4bd4-a355-78a62e69e05f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"
Sep 18 16:16:19.656848 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.656814    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv87z\" (UniqueName: \"kubernetes.io/projected/280a0bb0-8236-4bd4-a355-78a62e69e05f-kube-api-access-fv87z\") pod \"migrator-76794cbd6c-fdmg8\" (UID: \"280a0bb0-8236-4bd4-a355-78a62e69e05f\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"
Sep 18 16:16:19.697761 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.697728    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"
Sep 18 16:16:19.743861 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.743828    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.744099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:19.743878    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:19.744099 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.743990    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:16:19.744099 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.744020    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:19.744099 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.744077    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:20.744057365 +0000 UTC m=+37.235013811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:19.744099 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:19.744099    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:20.744088777 +0000 UTC m=+37.235045214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : configmap "kube-rbac-proxy" not found
Sep 18 16:16:20.198300 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.198265    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" event={"ID":"fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4","Type":"ContainerStarted","Data":"03693efe6e899ec2b9d593b97e9eb9625a6b8dfabb3a7270d108113b516ef820"}
Sep 18 16:16:20.223158 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.223097    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hc9z7" podStartSLOduration=7.410057411 podStartE2EDuration="36.223073894s" totalImagesPullingTime="28.813016483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:20.22262365 +0000 UTC m=+36.713580100" watchObservedRunningTime="2026-09-18 16:16:20.223073894 +0000 UTC m=+36.714030346"
Sep 18 16:16:20.588128 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.587920    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8"]
Sep 18 16:16:20.591357 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:20.591324    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280a0bb0_8236_4bd4_a355_78a62e69e05f.slice/crio-1760cc5d30061a96c13fe1c4cffb3f8c659e9234446f968b723d4326fa469418 WatchSource:0}: Error finding container 1760cc5d30061a96c13fe1c4cffb3f8c659e9234446f968b723d4326fa469418: Status 404 returned error can't find the container with id 1760cc5d30061a96c13fe1c4cffb3f8c659e9234446f968b723d4326fa469418
Sep 18 16:16:20.753172 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.753070    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:20.753172 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.753113    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:20.753414 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:20.753187    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:16:20.753414 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:20.753245    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:22.753228246 +0000 UTC m=+39.244184688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : configmap "kube-rbac-proxy" not found
Sep 18 16:16:20.753414 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:20.753254    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:20.753414 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:20.753289    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:22.753279262 +0000 UTC m=+39.244235705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:20.753618 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:20.753456    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2pp9_953c47d7-17b9-4d8f-8cf5-eabab7a756b8/dns-node-resolver/0.log"
Sep 18 16:16:21.056313 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.056218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:21.056451 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:21.056388    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:16:21.056451 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:21.056407    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g: secret "image-registry-tls" not found
Sep 18 16:16:21.056513 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:21.056464    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls podName:e6894d71-bf19-4524-b54e-49a1b395c98c nodeName:}" failed. No retries permitted until 2026-09-18 16:16:25.056447512 +0000 UTC m=+41.547403950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls") pod "image-registry-6fdfd6b8d8-gtn9g" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c") : secret "image-registry-tls" not found
Sep 18 16:16:21.106595 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.106557    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-p56nr"]
Sep 18 16:16:21.118771 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.118738    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-p56nr"]
Sep 18 16:16:21.119055 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.118873    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.122475 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.122264    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 16:16:21.122475 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.122340    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 16:16:21.122661 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.122527    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 16:16:21.123676 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.123489    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2kq7h\""
Sep 18 16:16:21.123676 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.123620    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 16:16:21.157218 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.157180    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:21.157395 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:21.157283    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:16:21.157395 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:21.157355    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls podName:0a0376ee-b526-4b8e-b7c0-0ad0b6c49029 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:25.157334891 +0000 UTC m=+41.648291337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls") pod "dns-default-qq425" (UID: "0a0376ee-b526-4b8e-b7c0-0ad0b6c49029") : secret "dns-default-metrics-tls" not found
Sep 18 16:16:21.202247 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.202203    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8" event={"ID":"280a0bb0-8236-4bd4-a355-78a62e69e05f","Type":"ContainerStarted","Data":"1760cc5d30061a96c13fe1c4cffb3f8c659e9234446f968b723d4326fa469418"}
Sep 18 16:16:21.204028 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.203986    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvt2x" event={"ID":"830cc37b-b3f1-4537-81ac-76d8f6abbf19","Type":"ContainerStarted","Data":"22624573c0e66fa0899203e5d9701ceffefe7377cf8494f6b86f12b1130d4f27"}
Sep 18 16:16:21.223188 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.223126    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rvt2x" podStartSLOduration=1.7636256129999999 podStartE2EDuration="4.223104146s" totalImagesPullingTime="2.459478533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:21.222808703 +0000 UTC m=+37.713765157" watchObservedRunningTime="2026-09-18 16:16:21.223104146 +0000 UTC m=+37.714060604"
Sep 18 16:16:21.257754 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.257710    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxhm\" (UniqueName: \"kubernetes.io/projected/417ce809-e200-4aa1-b2fe-f97bde713ca0-kube-api-access-fsxhm\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.257924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.257805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-key\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.257924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.257849    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-cabundle\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.359346 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.359199    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxhm\" (UniqueName: \"kubernetes.io/projected/417ce809-e200-4aa1-b2fe-f97bde713ca0-kube-api-access-fsxhm\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.359346 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.359319    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-key\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.359648 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.359622    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-cabundle\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.360444 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.360416    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-cabundle\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.363158 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.363131    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/417ce809-e200-4aa1-b2fe-f97bde713ca0-signing-key\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.368808 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.368784    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxhm\" (UniqueName: \"kubernetes.io/projected/417ce809-e200-4aa1-b2fe-f97bde713ca0-kube-api-access-fsxhm\") pod \"service-ca-55f6fc7b86-p56nr\" (UID: \"417ce809-e200-4aa1-b2fe-f97bde713ca0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.430772 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.430734    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr"
Sep 18 16:16:21.754774 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.754754    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqgrq_d0c50fd8-df66-4e5e-9c48-7439edc9682f/node-ca/0.log"
Sep 18 16:16:21.914801 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:21.914575    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-p56nr"]
Sep 18 16:16:21.917461 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:21.917433    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417ce809_e200_4aa1_b2fe_f97bde713ca0.slice/crio-f5b8b72f795385d3475e789563365b64d13f699fb3f741548ab7d1b1f26c3632 WatchSource:0}: Error finding container f5b8b72f795385d3475e789563365b64d13f699fb3f741548ab7d1b1f26c3632: Status 404 returned error can't find the container with id f5b8b72f795385d3475e789563365b64d13f699fb3f741548ab7d1b1f26c3632
Sep 18 16:16:22.208227 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.208151    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8" event={"ID":"280a0bb0-8236-4bd4-a355-78a62e69e05f","Type":"ContainerStarted","Data":"954fe589abf3c0351af6909b8a9593e84122da81f2373a61d6f650bb85ba9a9d"}
Sep 18 16:16:22.208227 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.208207    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8" event={"ID":"280a0bb0-8236-4bd4-a355-78a62e69e05f","Type":"ContainerStarted","Data":"ebe305126562a1b195c575965835bec424c5b2b8881a64757c619bf099866813"}
Sep 18 16:16:22.209280 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.209258    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr" event={"ID":"417ce809-e200-4aa1-b2fe-f97bde713ca0","Type":"ContainerStarted","Data":"f5b8b72f795385d3475e789563365b64d13f699fb3f741548ab7d1b1f26c3632"}
Sep 18 16:16:22.223788 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.223738    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fdmg8" podStartSLOduration=2.105171576 podStartE2EDuration="3.223719934s" totalImagesPullingTime="1.118548358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:22.223210824 +0000 UTC m=+38.714167275" watchObservedRunningTime="2026-09-18 16:16:22.223719934 +0000 UTC m=+38.714676386"
Sep 18 16:16:22.352901 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.352876    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvt2x_830cc37b-b3f1-4537-81ac-76d8f6abbf19/serve-healthcheck-canary/0.log"
Sep 18 16:16:22.768117 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.768080    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:22.768278 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:22.768128    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:22.768278 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:22.768213    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 16:16:22.768278 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:22.768235    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:22.768441 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:22.768285    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:26.768264299 +0000 UTC m=+43.259220744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : configmap "kube-rbac-proxy" not found
Sep 18 16:16:22.768441 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:22.768299    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:26.768292972 +0000 UTC m=+43.259249401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:25.089618 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:25.089579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:25.090014 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:25.089755    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 16:16:25.090014 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:25.089773    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g: secret "image-registry-tls" not found
Sep 18 16:16:25.090014 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:25.089827    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls podName:e6894d71-bf19-4524-b54e-49a1b395c98c nodeName:}" failed. No retries permitted until 2026-09-18 16:16:33.089811567 +0000 UTC m=+49.580768002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls") pod "image-registry-6fdfd6b8d8-gtn9g" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c") : secret "image-registry-tls" not found
Sep 18 16:16:25.190242 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:25.190206    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:25.190400 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:25.190365    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 16:16:25.190437 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:25.190429    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls podName:0a0376ee-b526-4b8e-b7c0-0ad0b6c49029 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:33.190414042 +0000 UTC m=+49.681370472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls") pod "dns-default-qq425" (UID: "0a0376ee-b526-4b8e-b7c0-0ad0b6c49029") : secret "dns-default-metrics-tls" not found
Sep 18 16:16:25.218866 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:25.218831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr" event={"ID":"417ce809-e200-4aa1-b2fe-f97bde713ca0","Type":"ContainerStarted","Data":"4e435ed0df8e733db528a30c3b1077994a9389af3c40e9f23147b59cafe15db0"}
Sep 18 16:16:25.235483 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:25.235443    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-p56nr" podStartSLOduration=1.700770056 podStartE2EDuration="4.235430728s" totalImagesPullingTime="2.534660672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:25.235207011 +0000 UTC m=+41.726163463" watchObservedRunningTime="2026-09-18 16:16:25.235430728 +0000 UTC m=+41.726387179"
Sep 18 16:16:26.803371 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:26.803325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:26.803899 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:26.803388    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:26.803899 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:26.803492    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:26.803899 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:16:26.803602    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls podName:f5b6fc67-bbdc-4686-bdaf-1ba49a762fea nodeName:}" failed. No retries permitted until 2026-09-18 16:16:34.803582759 +0000 UTC m=+51.294539517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n6t97" (UID: "f5b6fc67-bbdc-4686-bdaf-1ba49a762fea") : secret "insights-runtime-extractor-tls" not found
Sep 18 16:16:26.804128 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:26.804105    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:33.156122 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.156077    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:33.159373 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.159345    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"image-registry-6fdfd6b8d8-gtn9g\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") " pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:33.257257 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.257227    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:33.259465 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.259445    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a0376ee-b526-4b8e-b7c0-0ad0b6c49029-metrics-tls\") pod \"dns-default-qq425\" (UID: \"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029\") " pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:33.260414 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.260384    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:33.280554 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.280528    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:33.587553 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.587520    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:16:33.590895 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:33.590859    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6894d71_bf19_4524_b54e_49a1b395c98c.slice/crio-5867fa5e0d08b3b3074212dc57ba435d0b4705a27b41930e12659c37250a57c3 WatchSource:0}: Error finding container 5867fa5e0d08b3b3074212dc57ba435d0b4705a27b41930e12659c37250a57c3: Status 404 returned error can't find the container with id 5867fa5e0d08b3b3074212dc57ba435d0b4705a27b41930e12659c37250a57c3
Sep 18 16:16:33.604188 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:33.604166    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq425"]
Sep 18 16:16:33.620464 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:33.620436    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0376ee_b526_4b8e_b7c0_0ad0b6c49029.slice/crio-853cd7282e354d6f3189004d75a446daf534be7c022b2b02651e7e7f9fe4d199 WatchSource:0}: Error finding container 853cd7282e354d6f3189004d75a446daf534be7c022b2b02651e7e7f9fe4d199: Status 404 returned error can't find the container with id 853cd7282e354d6f3189004d75a446daf534be7c022b2b02651e7e7f9fe4d199
Sep 18 16:16:34.244911 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.244878    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" event={"ID":"e6894d71-bf19-4524-b54e-49a1b395c98c","Type":"ContainerStarted","Data":"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"}
Sep 18 16:16:34.245391 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.244936    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" event={"ID":"e6894d71-bf19-4524-b54e-49a1b395c98c","Type":"ContainerStarted","Data":"5867fa5e0d08b3b3074212dc57ba435d0b4705a27b41930e12659c37250a57c3"}
Sep 18 16:16:34.245391 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.244999    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:34.246005 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.245971    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq425" event={"ID":"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029","Type":"ContainerStarted","Data":"853cd7282e354d6f3189004d75a446daf534be7c022b2b02651e7e7f9fe4d199"}
Sep 18 16:16:34.268314 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.268270    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" podStartSLOduration=26.268257709 podStartE2EDuration="26.268257709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:34.266997321 +0000 UTC m=+50.757953771" watchObservedRunningTime="2026-09-18 16:16:34.268257709 +0000 UTC m=+50.759214159"
Sep 18 16:16:34.867967 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.867926    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:34.870757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.870729    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5b6fc67-bbdc-4686-bdaf-1ba49a762fea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n6t97\" (UID: \"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea\") " pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:34.976389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:34.976351    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n6t97"
Sep 18 16:16:35.258672 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:35.258640    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n6t97"]
Sep 18 16:16:35.530388 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:35.530319    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b6fc67_bbdc_4686_bdaf_1ba49a762fea.slice/crio-dcd98691ed9fa59ac40c4bf24eea430a76d4d7b95c61576b120dcba3c59fe2ba WatchSource:0}: Error finding container dcd98691ed9fa59ac40c4bf24eea430a76d4d7b95c61576b120dcba3c59fe2ba: Status 404 returned error can't find the container with id dcd98691ed9fa59ac40c4bf24eea430a76d4d7b95c61576b120dcba3c59fe2ba
Sep 18 16:16:36.255311 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.255278    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq425" event={"ID":"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029","Type":"ContainerStarted","Data":"9dbc3cffb71e01c07b81e2017bd8cd4223881717a3aa2bc3f949ae6a3c78ed2e"}
Sep 18 16:16:36.255461 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.255340    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq425" event={"ID":"0a0376ee-b526-4b8e-b7c0-0ad0b6c49029","Type":"ContainerStarted","Data":"b54f0596cffc1e44fc5b08c5bc612c23d700a8016cb2dc636187dc55714d570a"}
Sep 18 16:16:36.255461 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.255369    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:36.256937 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.256913    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6t97" event={"ID":"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea","Type":"ContainerStarted","Data":"fc4d4d101c1662688696fc8de376a19aebf5c8a8bb06007f348680b726a488c3"}
Sep 18 16:16:36.257012 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.256970    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6t97" event={"ID":"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea","Type":"ContainerStarted","Data":"dcd98691ed9fa59ac40c4bf24eea430a76d4d7b95c61576b120dcba3c59fe2ba"}
Sep 18 16:16:36.273706 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:36.273645    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qq425" podStartSLOduration=17.299912594 podStartE2EDuration="19.273631853s" totalImagesPullingTime="1.973719259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:36.271951487 +0000 UTC m=+52.762907937" watchObservedRunningTime="2026-09-18 16:16:36.273631853 +0000 UTC m=+52.764588340"
Sep 18 16:16:37.263652 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:37.263609    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6t97" event={"ID":"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea","Type":"ContainerStarted","Data":"7b1f7d8158dcd2114afb9f2dbaf628d1a0c1cbfea41142c88c8a3763eeda23a1"}
Sep 18 16:16:38.271643 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:38.271603    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n6t97" event={"ID":"f5b6fc67-bbdc-4686-bdaf-1ba49a762fea","Type":"ContainerStarted","Data":"3d8a77d444487f84abe885f9cadb2d47ad62348b5db98c2621dc9860a6875e2d"}
Sep 18 16:16:38.289739 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:38.289693    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n6t97" podStartSLOduration=17.347496587 podStartE2EDuration="19.289680106s" totalImagesPullingTime="1.942183519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:16:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:38.288204106 +0000 UTC m=+54.779160565" watchObservedRunningTime="2026-09-18 16:16:38.289680106 +0000 UTC m=+54.780636557"
Sep 18 16:16:43.179629 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:43.179598    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmk47"
Sep 18 16:16:45.925660 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:45.925627    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:16:45.990552 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:45.990518    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"]
Sep 18 16:16:45.993454 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:45.993432    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.008622 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.008599    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"]
Sep 18 16:16:46.040945 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.040919    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lhb\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-kube-api-access-b2lhb\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041078 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.040956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-certificates\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041078 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041009    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-ca-trust-extracted\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041078 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041046    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-tls\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041078 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-bound-sa-token\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041078 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041078    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-image-registry-private-configuration\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041271 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-installation-pull-secrets\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.041271 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.041158    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-trusted-ca\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.141899 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.141859    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-image-registry-private-configuration\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.141899 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.141903    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-installation-pull-secrets\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142189 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142044    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-trusted-ca\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142189 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142102    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lhb\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-kube-api-access-b2lhb\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142189 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142147    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-certificates\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142342 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142193    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-ca-trust-extracted\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142550 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142525    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-tls\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142678 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142561    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-bound-sa-token\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142744 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142670    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-ca-trust-extracted\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.142962 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.142942    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-trusted-ca\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.143062 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.143010    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-certificates\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.144836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.144813    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-registry-tls\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.144934 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.144918    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-image-registry-private-configuration\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.145117 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.145097    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-installation-pull-secrets\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.153010 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.152967    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lhb\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-kube-api-access-b2lhb\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.154468 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.154449    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bb1e00-9b6a-47dc-a804-4be1fcf3de36-bound-sa-token\") pod \"image-registry-6dd9d5f6f7-tmgb4\" (UID: \"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36\") " pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.266363 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.266334    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qq425"
Sep 18 16:16:46.302139 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.302111    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:46.576036 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:46.575937    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"]
Sep 18 16:16:46.578860 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:46.578839    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bb1e00_9b6a_47dc_a804_4be1fcf3de36.slice/crio-214506f5544a42ccf69d7b2cf5a31e8adc698ab26a8efdb2ed11c8f35d36dd67 WatchSource:0}: Error finding container 214506f5544a42ccf69d7b2cf5a31e8adc698ab26a8efdb2ed11c8f35d36dd67: Status 404 returned error can't find the container with id 214506f5544a42ccf69d7b2cf5a31e8adc698ab26a8efdb2ed11c8f35d36dd67
Sep 18 16:16:47.184796 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.184763    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-flsxv"]
Sep 18 16:16:47.187399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.187380    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:16:47.190087 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.190053    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 16:16:47.190227 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.190207    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-x42nk\""
Sep 18 16:16:47.193008 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.192302    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 16:16:47.212297 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.212270    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-flsxv"]
Sep 18 16:16:47.250946 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.250908    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjv26\" (UniqueName: \"kubernetes.io/projected/005bc971-21b7-4a84-a82a-20ddb07500ff-kube-api-access-sjv26\") pod \"downloads-6594f4c75-flsxv\" (UID: \"005bc971-21b7-4a84-a82a-20ddb07500ff\") " pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:16:47.271276 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.271242    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"]
Sep 18 16:16:47.273025 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.273011    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:47.275801 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.275778    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 16:16:47.276054 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.276035    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n6wrv\""
Sep 18 16:16:47.284476 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.284455    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"]
Sep 18 16:16:47.299465 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.299440    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4" event={"ID":"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36","Type":"ContainerStarted","Data":"bf69f6222f8ee4cd353bbd8a968c25c877d55c4f3d09c0bb33cfcc75d5fea9b9"}
Sep 18 16:16:47.299589 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.299484    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4" event={"ID":"a5bb1e00-9b6a-47dc-a804-4be1fcf3de36","Type":"ContainerStarted","Data":"214506f5544a42ccf69d7b2cf5a31e8adc698ab26a8efdb2ed11c8f35d36dd67"}
Sep 18 16:16:47.299589 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.299573    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:16:47.321474 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.321421    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4" podStartSLOduration=2.321399987 podStartE2EDuration="2.321399987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:47.321075463 +0000 UTC m=+63.812031915" watchObservedRunningTime="2026-09-18 16:16:47.321399987 +0000 UTC m=+63.812356438"
Sep 18 16:16:47.351705 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.351669    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjv26\" (UniqueName: \"kubernetes.io/projected/005bc971-21b7-4a84-a82a-20ddb07500ff-kube-api-access-sjv26\") pod \"downloads-6594f4c75-flsxv\" (UID: \"005bc971-21b7-4a84-a82a-20ddb07500ff\") " pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:16:47.351861 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.351798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cea2de1-c3af-4368-aa5e-b4b111d7c24d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pv65z\" (UID: \"9cea2de1-c3af-4368-aa5e-b4b111d7c24d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:47.360300 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.360271    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjv26\" (UniqueName: \"kubernetes.io/projected/005bc971-21b7-4a84-a82a-20ddb07500ff-kube-api-access-sjv26\") pod \"downloads-6594f4c75-flsxv\" (UID: \"005bc971-21b7-4a84-a82a-20ddb07500ff\") " pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:16:47.452291 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.452201    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cea2de1-c3af-4368-aa5e-b4b111d7c24d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pv65z\" (UID: \"9cea2de1-c3af-4368-aa5e-b4b111d7c24d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:47.454634 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.454614    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cea2de1-c3af-4368-aa5e-b4b111d7c24d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-pv65z\" (UID: \"9cea2de1-c3af-4368-aa5e-b4b111d7c24d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:47.499559 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.499521    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:16:47.582096 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.582052    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:47.769805 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.769782    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-flsxv"]
Sep 18 16:16:47.771938 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:47.771917    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005bc971_21b7_4a84_a82a_20ddb07500ff.slice/crio-80f17ae6e19cd36e586b37beb57bc6b41441d372189eb8ffe4e53b4c584cf9b6 WatchSource:0}: Error finding container 80f17ae6e19cd36e586b37beb57bc6b41441d372189eb8ffe4e53b4c584cf9b6: Status 404 returned error can't find the container with id 80f17ae6e19cd36e586b37beb57bc6b41441d372189eb8ffe4e53b4c584cf9b6
Sep 18 16:16:47.847069 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:47.847040    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"]
Sep 18 16:16:47.849716 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:47.849693    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cea2de1_c3af_4368_aa5e_b4b111d7c24d.slice/crio-23ccf99279be71c671eceb16c48b48b76d7897fdd249207465330f4a0dfcba1c WatchSource:0}: Error finding container 23ccf99279be71c671eceb16c48b48b76d7897fdd249207465330f4a0dfcba1c: Status 404 returned error can't find the container with id 23ccf99279be71c671eceb16c48b48b76d7897fdd249207465330f4a0dfcba1c
Sep 18 16:16:48.304072 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:48.304041    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z" event={"ID":"9cea2de1-c3af-4368-aa5e-b4b111d7c24d","Type":"ContainerStarted","Data":"23ccf99279be71c671eceb16c48b48b76d7897fdd249207465330f4a0dfcba1c"}
Sep 18 16:16:48.305115 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:48.305092    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-flsxv" event={"ID":"005bc971-21b7-4a84-a82a-20ddb07500ff","Type":"ContainerStarted","Data":"80f17ae6e19cd36e586b37beb57bc6b41441d372189eb8ffe4e53b4c584cf9b6"}
Sep 18 16:16:49.670989 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.670887    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:49.673571 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.673542    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 16:16:49.684098 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.684075    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a497cea-5563-452c-a622-16becb8a0134-original-pull-secret\") pod \"global-pull-secret-syncer-dqnn7\" (UID: \"7a497cea-5563-452c-a622-16becb8a0134\") " pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:49.771492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.771396    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:49.775016 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.774992    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 16:16:49.784081 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.784042    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d13926e-bdb5-457f-919a-5557417a65ad-metrics-certs\") pod \"network-metrics-daemon-9m57n\" (UID: \"5d13926e-bdb5-457f-919a-5557417a65ad\") " pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:49.805148 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.805124    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dqnn7"
Sep 18 16:16:49.872535 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.872442    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:49.875421 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.875393    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 16:16:49.885264 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.885243    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 16:16:49.897323 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.897241    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfsrd\" (UniqueName: \"kubernetes.io/projected/611a5dfd-7899-4ad7-8729-4def26a816b1-kube-api-access-dfsrd\") pod \"network-check-target-ch6l6\" (UID: \"611a5dfd-7899-4ad7-8729-4def26a816b1\") " pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:49.910799 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.910773    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8kmlw\""
Sep 18 16:16:49.917122 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:49.917066    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9m57n"
Sep 18 16:16:50.112544 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.112510    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dqnn7"]
Sep 18 16:16:50.112795 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.112777    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42l89\""
Sep 18 16:16:50.115027 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:50.114999    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a497cea_5563_452c_a622_16becb8a0134.slice/crio-ad725b75d0eca5be8edb75aa4844f4ef5d9c80e35b93b8743a7fd1975f4bf8c2 WatchSource:0}: Error finding container ad725b75d0eca5be8edb75aa4844f4ef5d9c80e35b93b8743a7fd1975f4bf8c2: Status 404 returned error can't find the container with id ad725b75d0eca5be8edb75aa4844f4ef5d9c80e35b93b8743a7fd1975f4bf8c2
Sep 18 16:16:50.120617 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.120592    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:50.225841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.225758    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9m57n"]
Sep 18 16:16:50.228630 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:50.228605    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d13926e_bdb5_457f_919a_5557417a65ad.slice/crio-541f2dc151d2dc2777d4302f92a8c15fa9aff1a276dc90a0e4097c042b1c3d37 WatchSource:0}: Error finding container 541f2dc151d2dc2777d4302f92a8c15fa9aff1a276dc90a0e4097c042b1c3d37: Status 404 returned error can't find the container with id 541f2dc151d2dc2777d4302f92a8c15fa9aff1a276dc90a0e4097c042b1c3d37
Sep 18 16:16:50.314351 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.314311    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9m57n" event={"ID":"5d13926e-bdb5-457f-919a-5557417a65ad","Type":"ContainerStarted","Data":"541f2dc151d2dc2777d4302f92a8c15fa9aff1a276dc90a0e4097c042b1c3d37"}
Sep 18 16:16:50.315689 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.315636    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dqnn7" event={"ID":"7a497cea-5563-452c-a622-16becb8a0134","Type":"ContainerStarted","Data":"ad725b75d0eca5be8edb75aa4844f4ef5d9c80e35b93b8743a7fd1975f4bf8c2"}
Sep 18 16:16:50.317501 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.317474    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z" event={"ID":"9cea2de1-c3af-4368-aa5e-b4b111d7c24d","Type":"ContainerStarted","Data":"3a156da64bf4e68c59cadcfcb0738e1c53598a763a7c70fe2145ffc41e80baaf"}
Sep 18 16:16:50.317720 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.317694    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:50.323777 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.323754    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z"
Sep 18 16:16:50.334145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.334097    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-pv65z" podStartSLOduration=1.7809447710000001 podStartE2EDuration="3.334084324s" totalImagesPullingTime="1.553139553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:50.332899869 +0000 UTC m=+66.823856320" watchObservedRunningTime="2026-09-18 16:16:50.334084324 +0000 UTC m=+66.825040775"
Sep 18 16:16:50.429696 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:50.429414    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ch6l6"]
Sep 18 16:16:50.432241 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:16:50.432214    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611a5dfd_7899_4ad7_8729_4def26a816b1.slice/crio-883a90ff77560444d99b2b3ba9af94cd3a716483c45623d00e9fed1186cd3f9d WatchSource:0}: Error finding container 883a90ff77560444d99b2b3ba9af94cd3a716483c45623d00e9fed1186cd3f9d: Status 404 returned error can't find the container with id 883a90ff77560444d99b2b3ba9af94cd3a716483c45623d00e9fed1186cd3f9d
Sep 18 16:16:51.325355 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:51.324852    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ch6l6" event={"ID":"611a5dfd-7899-4ad7-8729-4def26a816b1","Type":"ContainerStarted","Data":"883a90ff77560444d99b2b3ba9af94cd3a716483c45623d00e9fed1186cd3f9d"}
Sep 18 16:16:52.331735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:52.331699    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9m57n" event={"ID":"5d13926e-bdb5-457f-919a-5557417a65ad","Type":"ContainerStarted","Data":"a18afe22cb8f5c135b76bccc19aabe9d93134a1d4402d4fc5cdd8c563897fe74"}
Sep 18 16:16:52.332187 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:52.331756    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9m57n" event={"ID":"5d13926e-bdb5-457f-919a-5557417a65ad","Type":"ContainerStarted","Data":"13de2128b51361151a385a0a67e93f0a88223fb40eca2b82f2204cc2515cf624"}
Sep 18 16:16:52.349559 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:52.349109    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9m57n" podStartSLOduration=67.109230717 podStartE2EDuration="1m8.349089044s" totalImagesPullingTime="1.239858327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:52.348018623 +0000 UTC m=+68.838975064" watchObservedRunningTime="2026-09-18 16:16:52.349089044 +0000 UTC m=+68.840045497"
Sep 18 16:16:55.933731 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:55.933659    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:16:56.355958 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:56.355914    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dqnn7" event={"ID":"7a497cea-5563-452c-a622-16becb8a0134","Type":"ContainerStarted","Data":"78f5038b720b381606e2489d58616ab38b12c5c6b3e1188852a0e0c04e0f88ac"}
Sep 18 16:16:56.357774 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:56.357748    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ch6l6" event={"ID":"611a5dfd-7899-4ad7-8729-4def26a816b1","Type":"ContainerStarted","Data":"d7a8a437f38e02fe904efc12e0e64ae131e3a8ffc39ba448e7bc1a7053c7b7a8"}
Sep 18 16:16:56.357924 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:56.357903    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:16:56.371442 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:56.371259    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dqnn7" podStartSLOduration=66.425384977 podStartE2EDuration="1m12.371241946s" totalImagesPullingTime="5.945856969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:56.37103563 +0000 UTC m=+72.861992080" watchObservedRunningTime="2026-09-18 16:16:56.371241946 +0000 UTC m=+72.862198399"
Sep 18 16:16:56.388769 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:56.388716    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ch6l6" podStartSLOduration=66.760435825 podStartE2EDuration="1m12.388698261s" totalImagesPullingTime="5.628262436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:56.388366149 +0000 UTC m=+72.879322599" watchObservedRunningTime="2026-09-18 16:16:56.388698261 +0000 UTC m=+72.879654713"
Sep 18 16:16:57.760314 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.760276    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cxdbs"]
Sep 18 16:16:57.779754 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.779725    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.782515 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.782479    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vpzqb\""
Sep 18 16:16:57.782907 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.782880    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 16:16:57.782907 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.782889    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 16:16:57.784137 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.784112    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 16:16:57.784240 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.784112    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 16:16:57.784240 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.784117    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 16:16:57.784359 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.784117    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 16:16:57.838922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.838892    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-sys\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.838922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.838927    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-wtmp\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839179 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.838961    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-textfile\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839179 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839073    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-tls\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839179 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839119    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839179 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839153    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-metrics-client-ca\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839337 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839180    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839337 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839262    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-root\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.839337 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.839294    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4z2k\" (UniqueName: \"kubernetes.io/projected/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-kube-api-access-x4z2k\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940070 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940022    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-sys\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940070 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940071    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-wtmp\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940103    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-textfile\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940127    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-tls\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940135    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-sys\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940154    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940215    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-metrics-client-ca\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940244    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940291    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-root\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940295    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-wtmp\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940721 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940316    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4z2k\" (UniqueName: \"kubernetes.io/projected/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-kube-api-access-x4z2k\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940721 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940423    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-root\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940721 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940501    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-textfile\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940887 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940865    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.940939 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.940870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-metrics-client-ca\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.942832 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.942802    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.942950 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.942850    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-node-exporter-tls\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:57.953630 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:57.953600    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4z2k\" (UniqueName: \"kubernetes.io/projected/9d592c58-a5fb-43e5-ad36-4877d7b5abd9-kube-api-access-x4z2k\") pod \"node-exporter-cxdbs\" (UID: \"9d592c58-a5fb-43e5-ad36-4877d7b5abd9\") " pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:16:58.090989 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:16:58.090899    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxdbs"
Sep 18 16:17:04.877751 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:17:04.877719    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d592c58_a5fb_43e5_ad36_4877d7b5abd9.slice/crio-e74da04a34955f916b99971e517a187f6c9966e8dcb14e070904a0fa112bd035 WatchSource:0}: Error finding container e74da04a34955f916b99971e517a187f6c9966e8dcb14e070904a0fa112bd035: Status 404 returned error can't find the container with id e74da04a34955f916b99971e517a187f6c9966e8dcb14e070904a0fa112bd035
Sep 18 16:17:05.283755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.283711    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:17:05.288344 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.288317    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.291763 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.291736    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 16:17:05.293454 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.293431    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 16:17:05.293581 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.293535    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 16:17:05.294610 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.294590    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nj9v\""
Sep 18 16:17:05.294994 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.294961    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 16:17:05.295346 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.295323    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 16:17:05.299161 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.299137    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 16:17:05.307926 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.307900    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:17:05.395592 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.395546    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxdbs" event={"ID":"9d592c58-a5fb-43e5-ad36-4877d7b5abd9","Type":"ContainerStarted","Data":"e74da04a34955f916b99971e517a187f6c9966e8dcb14e070904a0fa112bd035"}
Sep 18 16:17:05.397663 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.397633    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-flsxv" event={"ID":"005bc971-21b7-4a84-a82a-20ddb07500ff","Type":"ContainerStarted","Data":"b04560deddc7368dfeecc4a1e2581d5a1b967cd5c2ffd39ef12020d573ccef2e"}
Sep 18 16:17:05.397865 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.397842    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:17:05.397865 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.397855    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398030 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.397906    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398030 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.397934    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398518 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.398039    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398518 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.398063    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398518 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.398116    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.398518 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.398158    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nh8\" (UniqueName: \"kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.412176 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.412090    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-flsxv"
Sep 18 16:17:05.421731 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.421661    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-flsxv" podStartSLOduration=1.221394381 podStartE2EDuration="18.421641098s" totalImagesPullingTime="17.200246717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:17:05.419852982 +0000 UTC m=+81.910809436" watchObservedRunningTime="2026-09-18 16:17:05.421641098 +0000 UTC m=+81.912597549"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499526    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499575    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nh8\" (UniqueName: \"kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499671    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499701    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499728    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499766    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.499790    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.500968    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.501199    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.501455    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504032 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.504031    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504696 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.504284    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.504965 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.504873    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.518451 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.518403    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nh8\" (UniqueName: \"kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8\") pod \"console-6b9759cf5d-4bkt5\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") " pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.600637 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.600543    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:05.896784 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:05.896354    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:17:05.974090 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:17:05.974046    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ec0d87_3f7e_4c25_9672_72ef55d5d8c2.slice/crio-5f99aec325bf7d952b42c9e0e8f38c74a58a860206ee46a83ec227c6c21ba31b WatchSource:0}: Error finding container 5f99aec325bf7d952b42c9e0e8f38c74a58a860206ee46a83ec227c6c21ba31b: Status 404 returned error can't find the container with id 5f99aec325bf7d952b42c9e0e8f38c74a58a860206ee46a83ec227c6c21ba31b
Sep 18 16:17:06.403994 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:06.403829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9759cf5d-4bkt5" event={"ID":"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2","Type":"ContainerStarted","Data":"5f99aec325bf7d952b42c9e0e8f38c74a58a860206ee46a83ec227c6c21ba31b"}
Sep 18 16:17:06.405856 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:06.405822    2552 generic.go:356] "Generic (PLEG): container finished" podID="9d592c58-a5fb-43e5-ad36-4877d7b5abd9" containerID="0ca77c337f60ac933b9e517222eac07664092f7e4c41682c1ab3c04a818f9049" exitCode=0
Sep 18 16:17:06.406016 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:06.405923    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxdbs" event={"ID":"9d592c58-a5fb-43e5-ad36-4877d7b5abd9","Type":"ContainerDied","Data":"0ca77c337f60ac933b9e517222eac07664092f7e4c41682c1ab3c04a818f9049"}
Sep 18 16:17:07.415520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:07.415411    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxdbs" event={"ID":"9d592c58-a5fb-43e5-ad36-4877d7b5abd9","Type":"ContainerStarted","Data":"a5a49adf292f776aa97ce60439a0d374fb933e273225b47d144998a198c0e809"}
Sep 18 16:17:07.415520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:07.415480    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxdbs" event={"ID":"9d592c58-a5fb-43e5-ad36-4877d7b5abd9","Type":"ContainerStarted","Data":"7b1ec2ce964c97f6192892da83f5a7810a543983fa160a2540d3e564276bf797"}
Sep 18 16:17:07.451223 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:07.450844    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cxdbs" podStartSLOduration=9.216068242 podStartE2EDuration="10.450822283s" totalImagesPullingTime="1.15952617s" totalInitContainerRuntime="75.227871ms" isStatefulPod=true podCreationTimestamp="2026-09-18 16:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:17:07.44842263 +0000 UTC m=+83.939379084" watchObservedRunningTime="2026-09-18 16:17:07.450822283 +0000 UTC m=+83.941778735"
Sep 18 16:17:08.312014 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:08.311954    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dd9d5f6f7-tmgb4"
Sep 18 16:17:10.944269 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:10.944031    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" podUID="e6894d71-bf19-4524-b54e-49a1b395c98c" containerName="registry" containerID="cri-o://b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add" gracePeriod=30
Sep 18 16:17:11.438902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.438874    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:17:11.439994 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.439947    2552 generic.go:356] "Generic (PLEG): container finished" podID="e6894d71-bf19-4524-b54e-49a1b395c98c" containerID="b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add" exitCode=0
Sep 18 16:17:11.440134 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.440015    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" event={"ID":"e6894d71-bf19-4524-b54e-49a1b395c98c","Type":"ContainerDied","Data":"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"}
Sep 18 16:17:11.440134 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.440078    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g" event={"ID":"e6894d71-bf19-4524-b54e-49a1b395c98c","Type":"ContainerDied","Data":"5867fa5e0d08b3b3074212dc57ba435d0b4705a27b41930e12659c37250a57c3"}
Sep 18 16:17:11.440134 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.440103    2552 scope.go:117] "RemoveContainer" containerID="b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"
Sep 18 16:17:11.563010 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.562912    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563212 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563013    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563212 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563049    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563212 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563096    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563263    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563308    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563355    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9jx8\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563535 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563385    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets\") pod \"e6894d71-bf19-4524-b54e-49a1b395c98c\" (UID: \"e6894d71-bf19-4524-b54e-49a1b395c98c\") "
Sep 18 16:17:11.563535 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563412    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:17:11.563641 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.563611    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-certificates\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.567172 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.567133    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:17:11.567562 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.567510    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8" (OuterVolumeSpecName: "kube-api-access-z9jx8") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "kube-api-access-z9jx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:17:11.567744 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.567720    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:17:11.568246 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.568219    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:17:11.568680 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.568652    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:17:11.568767 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.568711    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:17:11.575291 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.575264    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e6894d71-bf19-4524-b54e-49a1b395c98c" (UID: "e6894d71-bf19-4524-b54e-49a1b395c98c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 16:17:11.645453 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.645405    2552 scope.go:117] "RemoveContainer" containerID="b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"
Sep 18 16:17:11.645937 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:17:11.645904    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add\": container with ID starting with b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add not found: ID does not exist" containerID="b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"
Sep 18 16:17:11.646044 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.645948    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add"} err="failed to get container status \"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add\": rpc error: code = NotFound desc = could not find container \"b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add\": container with ID starting with b74346edfd861021df5733d9ba33d47372b66014ae0f8eda7345186314fd0add not found: ID does not exist"
Sep 18 16:17:11.664033 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664009    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9jx8\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-kube-api-access-z9jx8\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664037    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-installation-pull-secrets\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664052    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6894d71-bf19-4524-b54e-49a1b395c98c-trusted-ca\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664062    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-registry-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664077    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6894d71-bf19-4524-b54e-49a1b395c98c-image-registry-private-configuration\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664091    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6894d71-bf19-4524-b54e-49a1b395c98c-ca-trust-extracted\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:11.664147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:11.664104    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6894d71-bf19-4524-b54e-49a1b395c98c-bound-sa-token\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:17:12.446635 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:12.446551    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9759cf5d-4bkt5" event={"ID":"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2","Type":"ContainerStarted","Data":"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"}
Sep 18 16:17:12.447872 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:12.447847    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"
Sep 18 16:17:12.481714 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:12.481666    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9759cf5d-4bkt5" podStartSLOduration=1.796980414 podStartE2EDuration="7.481648801s" totalImagesPullingTime="5.684668387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:17:12.479110955 +0000 UTC m=+88.970067408" watchObservedRunningTime="2026-09-18 16:17:12.481648801 +0000 UTC m=+88.972605251"
Sep 18 16:17:12.515338 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:12.515306    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:17:12.541700 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:12.541671    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fdfd6b8d8-gtn9g"]
Sep 18 16:17:14.000340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:14.000298    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6894d71-bf19-4524-b54e-49a1b395c98c" path="/var/lib/kubelet/pods/e6894d71-bf19-4524-b54e-49a1b395c98c/volumes"
Sep 18 16:17:15.601513 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:15.601470    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:15.602009 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:15.601548    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:15.606053 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:15.606028    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:16.465065 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:16.465038    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:17:27.366827 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:17:27.366789    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ch6l6"
Sep 18 16:18:26.549913 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.549869    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:18:26.550348 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.550119    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6894d71-bf19-4524-b54e-49a1b395c98c" containerName="registry"
Sep 18 16:18:26.550348 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.550131    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6894d71-bf19-4524-b54e-49a1b395c98c" containerName="registry"
Sep 18 16:18:26.550348 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.550182    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6894d71-bf19-4524-b54e-49a1b395c98c" containerName="registry"
Sep 18 16:18:26.552471 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.552446    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.567042 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.567014    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:18:26.604622 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604594    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604746 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604629    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604746 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604645    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604746 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604673    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604746 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604746 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8bzr\" (UniqueName: \"kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.604904 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.604796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706257 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706222    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706257 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706258    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706600 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706275    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706600 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706302    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706600 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706600 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706373    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8bzr\" (UniqueName: \"kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.706600 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.706401    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.707117 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.707091    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.707221 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.707098    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.707221 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.707126    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.707352 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.707333    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.708810 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.708782    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.709100 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.709082    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.714995 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.714953    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8bzr\" (UniqueName: \"kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr\") pod \"console-5584cbf5dc-79qp9\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") " pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:26.861670 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:26.861585    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:27.136738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:27.136708    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:18:27.139238 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:18:27.139212    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1adb23e_3958_4f28_b3f5_ffab266c2ac1.slice/crio-96f87f9b8f124f97f621427d69d2cf368cdfdda09e31239ccff7dd04cd580bee WatchSource:0}: Error finding container 96f87f9b8f124f97f621427d69d2cf368cdfdda09e31239ccff7dd04cd580bee: Status 404 returned error can't find the container with id 96f87f9b8f124f97f621427d69d2cf368cdfdda09e31239ccff7dd04cd580bee
Sep 18 16:18:27.700749 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:27.700712    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5584cbf5dc-79qp9" event={"ID":"f1adb23e-3958-4f28-b3f5-ffab266c2ac1","Type":"ContainerStarted","Data":"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"}
Sep 18 16:18:27.701150 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:27.700765    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5584cbf5dc-79qp9" event={"ID":"f1adb23e-3958-4f28-b3f5-ffab266c2ac1","Type":"ContainerStarted","Data":"96f87f9b8f124f97f621427d69d2cf368cdfdda09e31239ccff7dd04cd580bee"}
Sep 18 16:18:27.724269 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:27.724201    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5584cbf5dc-79qp9" podStartSLOduration=1.724174522 podStartE2EDuration="1.724174522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:18:27.722922372 +0000 UTC m=+164.213878824" watchObservedRunningTime="2026-09-18 16:18:27.724174522 +0000 UTC m=+164.215131056"
Sep 18 16:18:36.862705 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:36.862616    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:36.862705 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:36.862695    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:36.867340 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:36.867314    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:37.739757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:37.739729    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:18:37.789611 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:18:37.789578    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:19:02.808507 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:02.808442    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b9759cf5d-4bkt5" podUID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" containerName="console" containerID="cri-o://67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b" gracePeriod=15
Sep 18 16:19:03.042550 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.042527    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:19:03.172778 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172688    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6nh8\" (UniqueName: \"kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.172778 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172732    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.172778 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172753    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.172778 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172780    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.173144 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172811    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.173144 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172840    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.173144 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.172873    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert\") pod \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\" (UID: \"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2\") "
Sep 18 16:19:03.173321 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.173287    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:19:03.173378 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.173295    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config" (OuterVolumeSpecName: "console-config") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:19:03.173378 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.173325    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:19:03.173482 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.173385    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:19:03.175049 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.175023    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:19:03.175154 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.175135    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:19:03.175193 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.175144    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8" (OuterVolumeSpecName: "kube-api-access-x6nh8") pod "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" (UID: "e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2"). InnerVolumeSpecName "kube-api-access-x6nh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:19:03.273579 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273549    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273579 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273574    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6nh8\" (UniqueName: \"kubernetes.io/projected/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-kube-api-access-x6nh8\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273579 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273584    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-oauth-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273593    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-service-ca\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273601    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-oauth-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273610    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-trusted-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.273757 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.273618    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2-console-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:19:03.825690 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.825654    2552 generic.go:356] "Generic (PLEG): container finished" podID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" containerID="67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b" exitCode=0
Sep 18 16:19:03.826097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.825703    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9759cf5d-4bkt5"
Sep 18 16:19:03.826097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.825743    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9759cf5d-4bkt5" event={"ID":"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2","Type":"ContainerDied","Data":"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"}
Sep 18 16:19:03.826097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.825814    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9759cf5d-4bkt5" event={"ID":"e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2","Type":"ContainerDied","Data":"5f99aec325bf7d952b42c9e0e8f38c74a58a860206ee46a83ec227c6c21ba31b"}
Sep 18 16:19:03.826097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.825839    2552 scope.go:117] "RemoveContainer" containerID="67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"
Sep 18 16:19:03.834430 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.834414    2552 scope.go:117] "RemoveContainer" containerID="67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"
Sep 18 16:19:03.834718 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:19:03.834697    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b\": container with ID starting with 67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b not found: ID does not exist" containerID="67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"
Sep 18 16:19:03.834771 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.834726    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b"} err="failed to get container status \"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b\": rpc error: code = NotFound desc = could not find container \"67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b\": container with ID starting with 67d3cac350d302b2a30de1b286a2c2bfc53b4daf15e6821937a152366e6c116b not found: ID does not exist"
Sep 18 16:19:03.847650 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.847626    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:19:03.852174 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.852155    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9759cf5d-4bkt5"]
Sep 18 16:19:03.998885 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:03.998853    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" path="/var/lib/kubelet/pods/e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2/volumes"
Sep 18 16:19:47.158872 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.158836    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:19:47.159288 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.159095    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" containerName="console"
Sep 18 16:19:47.159288 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.159107    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" containerName="console"
Sep 18 16:19:47.159288 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.159167    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ec0d87-3f7e-4c25-9672-72ef55d5d8c2" containerName="console"
Sep 18 16:19:47.162185 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.162169    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.173662 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.173633    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:19:47.269399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269359    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269402    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269429    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhsz6\" (UniqueName: \"kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269485    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269537    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.269620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.269582    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370309 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370280    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhsz6\" (UniqueName: \"kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370428 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370319    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370428 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370428 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370426    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370548 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370446    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370548 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370481    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.370548 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.370520    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.371238 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.371212    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.371389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.371318    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.371458 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.371392    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.371458 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.371428    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.372945 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.372916    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.373074 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.373051    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.379357 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.379336    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhsz6\" (UniqueName: \"kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6\") pod \"console-5dfdfdb477-j2k8h\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") " pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.471082 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.470997    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:47.743948 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.743787    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:19:47.746516 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:19:47.746482    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74128f0c_cf76_4ec1_8ee9_c8ac95995fb0.slice/crio-a2f4bf44de6f2f1b417e94c49121f8706d6bd3046d015b4316f60be3cf73006c WatchSource:0}: Error finding container a2f4bf44de6f2f1b417e94c49121f8706d6bd3046d015b4316f60be3cf73006c: Status 404 returned error can't find the container with id a2f4bf44de6f2f1b417e94c49121f8706d6bd3046d015b4316f60be3cf73006c
Sep 18 16:19:47.984107 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.984070    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdfdb477-j2k8h" event={"ID":"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0","Type":"ContainerStarted","Data":"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"}
Sep 18 16:19:47.984286 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:47.984130    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdfdb477-j2k8h" event={"ID":"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0","Type":"ContainerStarted","Data":"a2f4bf44de6f2f1b417e94c49121f8706d6bd3046d015b4316f60be3cf73006c"}
Sep 18 16:19:48.001930 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:48.001841    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dfdfdb477-j2k8h" podStartSLOduration=1.001826127 podStartE2EDuration="1.001826127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:19:48.001080458 +0000 UTC m=+244.492036907" watchObservedRunningTime="2026-09-18 16:19:48.001826127 +0000 UTC m=+244.492782574"
Sep 18 16:19:57.471810 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:57.471750    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:57.472445 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:57.471864    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:57.476596 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:57.476570    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:58.020269 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:58.020239    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:19:58.071197 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:19:58.071164    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:20:23.090950 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.090900    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5584cbf5dc-79qp9" podUID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" containerName="console" containerID="cri-o://f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376" gracePeriod=15
Sep 18 16:20:23.332226 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.332194    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:20:23.439369 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439276    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439369 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439325    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8bzr\" (UniqueName: \"kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439369 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439371    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439638 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439392    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439638 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439432    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439638 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439456    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439638 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439478    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle\") pod \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\" (UID: \"f1adb23e-3958-4f28-b3f5-ffab266c2ac1\") "
Sep 18 16:20:23.439838 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439816    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config" (OuterVolumeSpecName: "console-config") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:20:23.439906 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439868    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:20:23.439906 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439884    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:20:23.440037 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.439952    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:20:23.441542 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.441514    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:20:23.441665 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.441591    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr" (OuterVolumeSpecName: "kube-api-access-d8bzr") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "kube-api-access-d8bzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:20:23.441720 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.441655    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1adb23e-3958-4f28-b3f5-ffab266c2ac1" (UID: "f1adb23e-3958-4f28-b3f5-ffab266c2ac1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:20:23.540826 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540785    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.540826 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540816    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-oauth-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.540826 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540825    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-service-ca\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.540826 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540834    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.541099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540842    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-trusted-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.541099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540850    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-console-oauth-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:23.541099 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:23.540861    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8bzr\" (UniqueName: \"kubernetes.io/projected/f1adb23e-3958-4f28-b3f5-ffab266c2ac1-kube-api-access-d8bzr\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:20:24.106836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.106795    2552 generic.go:356] "Generic (PLEG): container finished" podID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" containerID="f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376" exitCode=0
Sep 18 16:20:24.107239 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.106846    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5584cbf5dc-79qp9"
Sep 18 16:20:24.107239 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.106857    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5584cbf5dc-79qp9" event={"ID":"f1adb23e-3958-4f28-b3f5-ffab266c2ac1","Type":"ContainerDied","Data":"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"}
Sep 18 16:20:24.107239 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.106906    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5584cbf5dc-79qp9" event={"ID":"f1adb23e-3958-4f28-b3f5-ffab266c2ac1","Type":"ContainerDied","Data":"96f87f9b8f124f97f621427d69d2cf368cdfdda09e31239ccff7dd04cd580bee"}
Sep 18 16:20:24.107239 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.106933    2552 scope.go:117] "RemoveContainer" containerID="f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"
Sep 18 16:20:24.116630 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.116604    2552 scope.go:117] "RemoveContainer" containerID="f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"
Sep 18 16:20:24.116946 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:20:24.116924    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376\": container with ID starting with f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376 not found: ID does not exist" containerID="f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"
Sep 18 16:20:24.117027 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.116956    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376"} err="failed to get container status \"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376\": rpc error: code = NotFound desc = could not find container \"f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376\": container with ID starting with f5d4d801d608e6d774898bc5a67ea48f306291882727f5f51cf0e833beef7376 not found: ID does not exist"
Sep 18 16:20:24.132176 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.132130    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:20:24.136592 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:24.136561    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5584cbf5dc-79qp9"]
Sep 18 16:20:25.999485 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:25.999446    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" path="/var/lib/kubelet/pods/f1adb23e-3958-4f28-b3f5-ffab266c2ac1/volumes"
Sep 18 16:20:43.870013 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:43.869966    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:20:43.874740 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:43.874717    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:20:43.876865 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:20:43.876839    2552 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 16:21:40.881335 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.881253    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"]
Sep 18 16:21:40.881771 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.881501    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" containerName="console"
Sep 18 16:21:40.881771 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.881511    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" containerName="console"
Sep 18 16:21:40.881771 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.881559    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1adb23e-3958-4f28-b3f5-ffab266c2ac1" containerName="console"
Sep 18 16:21:40.884240 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.884222    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:40.887284 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.887262    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 16:21:40.887446 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.887434    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hwbdj\""
Sep 18 16:21:40.888596 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.888575    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 16:21:40.897139 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.897119    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"]
Sep 18 16:21:40.964968 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.964942    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:40.964968 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.964971    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:40.965135 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:40.965002    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhh2k\" (UniqueName: \"kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.065695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.065666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.065695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.065699    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.065882 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.065718    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhh2k\" (UniqueName: \"kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.066053 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.066037    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.066144 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.066070    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.073809 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.073781    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhh2k\" (UniqueName: \"kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.193215 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.193130    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:21:41.461740 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.461650    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"]
Sep 18 16:21:41.464282 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:21:41.464230    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d35bab6_7c4c_447c_8674_f869543d64bb.slice/crio-0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab WatchSource:0}: Error finding container 0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab: Status 404 returned error can't find the container with id 0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab
Sep 18 16:21:41.466237 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:41.466216    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:21:42.371185 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.371147    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerStarted","Data":"0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab"}
Sep 18 16:21:42.660270 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.660172    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"]
Sep 18 16:21:42.663334 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.663313    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.666290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.666266    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 16:21:42.666502 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.666486    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 16:21:42.666723 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.666523    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 16:21:42.667426 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.667408    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 16:21:42.667512 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.667494    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 16:21:42.667572 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.667526    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 16:21:42.667846 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.667825    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 16:21:42.677191 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.677169    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"]
Sep 18 16:21:42.779540 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779506    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.779735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779574    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsttw\" (UniqueName: \"kubernetes.io/projected/c6d49f7f-c4c9-4998-af4a-20d767374b2f-kube-api-access-nsttw\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.779735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779656    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6d49f7f-c4c9-4998-af4a-20d767374b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.779735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779689    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.779735 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779716    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.779875 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.779784    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.880944 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.880910    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsttw\" (UniqueName: \"kubernetes.io/projected/c6d49f7f-c4c9-4998-af4a-20d767374b2f-kube-api-access-nsttw\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.880954    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6d49f7f-c4c9-4998-af4a-20d767374b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.880991    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.881018    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.881049    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881145 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.881089    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.881774 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.881741    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6d49f7f-c4c9-4998-af4a-20d767374b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.883941 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.883915    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.884503 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.884475    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-ca\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.884620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.884502    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.884620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.884576    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6d49f7f-c4c9-4998-af4a-20d767374b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.890511 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.890486    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsttw\" (UniqueName: \"kubernetes.io/projected/c6d49f7f-c4c9-4998-af4a-20d767374b2f-kube-api-access-nsttw\") pod \"cluster-proxy-proxy-agent-6fc6496969-hsz4m\" (UID: \"c6d49f7f-c4c9-4998-af4a-20d767374b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:42.984991 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:42.984949    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"
Sep 18 16:21:43.264001 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:43.263892    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m"]
Sep 18 16:21:43.267375 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:21:43.267343    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6d49f7f_c4c9_4998_af4a_20d767374b2f.slice/crio-7c706a2dba16cbdc07e78d43220375eda85c110b1e1c8cff2d0cdc82801237fc WatchSource:0}: Error finding container 7c706a2dba16cbdc07e78d43220375eda85c110b1e1c8cff2d0cdc82801237fc: Status 404 returned error can't find the container with id 7c706a2dba16cbdc07e78d43220375eda85c110b1e1c8cff2d0cdc82801237fc
Sep 18 16:21:43.377164 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:43.377126    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m" event={"ID":"c6d49f7f-c4c9-4998-af4a-20d767374b2f","Type":"ContainerStarted","Data":"7c706a2dba16cbdc07e78d43220375eda85c110b1e1c8cff2d0cdc82801237fc"}
Sep 18 16:21:49.403250 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.403207    2552 generic.go:356] "Generic (PLEG): container finished" podID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerID="0ed20c03b500dae8357f4525b399ee90af752cadb636018f6d304b03f92659ac" exitCode=0
Sep 18 16:21:49.403709 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.403299    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerDied","Data":"0ed20c03b500dae8357f4525b399ee90af752cadb636018f6d304b03f92659ac"}
Sep 18 16:21:49.405516 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.405489    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m" event={"ID":"c6d49f7f-c4c9-4998-af4a-20d767374b2f","Type":"ContainerStarted","Data":"a404181e90b23b80971ae454b619a9a3854a2ec1cc18977c97ef4c9b2e1958c0"}
Sep 18 16:21:49.405594 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.405529    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m" event={"ID":"c6d49f7f-c4c9-4998-af4a-20d767374b2f","Type":"ContainerStarted","Data":"ab5fd6a61628ce1aa789f2de02933d1165351e0f3172da25ecbdea5710bd7972"}
Sep 18 16:21:49.405594 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.405549    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m" event={"ID":"c6d49f7f-c4c9-4998-af4a-20d767374b2f","Type":"ContainerStarted","Data":"17fd30cc68931e48e2a797dc8660de36444751faa4ca8c2f4c54acbff061c5d3"}
Sep 18 16:21:49.442679 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:49.442617    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fc6496969-hsz4m" podStartSLOduration=2.077832641 podStartE2EDuration="7.442600005s" totalImagesPullingTime="5.364767364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:21:49.441369118 +0000 UTC m=+365.932325570" watchObservedRunningTime="2026-09-18 16:21:49.442600005 +0000 UTC m=+365.933556456"
Sep 18 16:21:52.424484 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:52.424451    2552 generic.go:356] "Generic (PLEG): container finished" podID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerID="89260a6a3b8a57cae842722a1f1ad27ac0e2cffcc817170b786695db37924296" exitCode=0
Sep 18 16:21:52.424834 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:52.424533    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerDied","Data":"89260a6a3b8a57cae842722a1f1ad27ac0e2cffcc817170b786695db37924296"}
Sep 18 16:21:59.454574 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:59.454534    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerStarted","Data":"a7e5b8b42d00f4eb607a0b8358bc24ec37d484d2fae436f08a2247fdf7709ebd"}
Sep 18 16:21:59.473501 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:21:59.473441    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" podStartSLOduration=3.1781882870000002 podStartE2EDuration="19.473422293s" totalImagesPullingTime="16.295234006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:21:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:21:59.473163509 +0000 UTC m=+375.964119962" watchObservedRunningTime="2026-09-18 16:21:59.473422293 +0000 UTC m=+375.964378746"
Sep 18 16:22:00.460284 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:00.460251    2552 generic.go:356] "Generic (PLEG): container finished" podID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerID="a7e5b8b42d00f4eb607a0b8358bc24ec37d484d2fae436f08a2247fdf7709ebd" exitCode=0
Sep 18 16:22:00.460663 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:00.460301    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerDied","Data":"a7e5b8b42d00f4eb607a0b8358bc24ec37d484d2fae436f08a2247fdf7709ebd"}
Sep 18 16:22:01.582638 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.582613    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:22:01.741466 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.741433    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle\") pod \"4d35bab6-7c4c-447c-8674-f869543d64bb\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") "
Sep 18 16:22:01.741618 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.741504    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util\") pod \"4d35bab6-7c4c-447c-8674-f869543d64bb\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") "
Sep 18 16:22:01.741618 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.741535    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhh2k\" (UniqueName: \"kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k\") pod \"4d35bab6-7c4c-447c-8674-f869543d64bb\" (UID: \"4d35bab6-7c4c-447c-8674-f869543d64bb\") "
Sep 18 16:22:01.742239 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.742201    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle" (OuterVolumeSpecName: "bundle") pod "4d35bab6-7c4c-447c-8674-f869543d64bb" (UID: "4d35bab6-7c4c-447c-8674-f869543d64bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 16:22:01.743676 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.743651    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k" (OuterVolumeSpecName: "kube-api-access-nhh2k") pod "4d35bab6-7c4c-447c-8674-f869543d64bb" (UID: "4d35bab6-7c4c-447c-8674-f869543d64bb"). InnerVolumeSpecName "kube-api-access-nhh2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:22:01.747421 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.747380    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util" (OuterVolumeSpecName: "util") pod "4d35bab6-7c4c-447c-8674-f869543d64bb" (UID: "4d35bab6-7c4c-447c-8674-f869543d64bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 16:22:01.842642 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.842611    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:01.842642 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.842636    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d35bab6-7c4c-447c-8674-f869543d64bb-util\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:01.842642 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:01.842645    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhh2k\" (UniqueName: \"kubernetes.io/projected/4d35bab6-7c4c-447c-8674-f869543d64bb-kube-api-access-nhh2k\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:02.469886 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:02.469817    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l" event={"ID":"4d35bab6-7c4c-447c-8674-f869543d64bb","Type":"ContainerDied","Data":"0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab"}
Sep 18 16:22:02.469886 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:02.469862    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1awjc4l"
Sep 18 16:22:02.470084 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:02.469864    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0487e972d9086e534ac5c765c0ca01d543477798b56d748b321b2d36f21d44ab"
Sep 18 16:22:08.738918 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.738883    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"]
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739138    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="pull"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739149    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="pull"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739157    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="extract"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739163    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="extract"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739176    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="util"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739182    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="util"
Sep 18 16:22:08.739383 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.739224    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d35bab6-7c4c-447c-8674-f869543d64bb" containerName="extract"
Sep 18 16:22:08.740620 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.740602    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:08.743422 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.743401    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 18 16:22:08.743568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.743499    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 18 16:22:08.743568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.743499    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-qb4g9\""
Sep 18 16:22:08.743568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.743500    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 18 16:22:08.753821 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.753789    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"]
Sep 18 16:22:08.892217 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.892178    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtzz\" (UniqueName: \"kubernetes.io/projected/b46dba3d-fc49-4a24-b024-42917113edae-kube-api-access-6wtzz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:08.892403 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.892266    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b46dba3d-fc49-4a24-b024-42917113edae-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:08.993247 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.993165    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b46dba3d-fc49-4a24-b024-42917113edae-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:08.993247 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.993207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtzz\" (UniqueName: \"kubernetes.io/projected/b46dba3d-fc49-4a24-b024-42917113edae-kube-api-access-6wtzz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:08.995592 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:08.995551    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b46dba3d-fc49-4a24-b024-42917113edae-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:09.002807 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:09.002782    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtzz\" (UniqueName: \"kubernetes.io/projected/b46dba3d-fc49-4a24-b024-42917113edae-kube-api-access-6wtzz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-hsl5l\" (UID: \"b46dba3d-fc49-4a24-b024-42917113edae\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:09.055761 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:09.055718    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:09.331332 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:09.331309    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"]
Sep 18 16:22:09.333076 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:22:09.333049    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46dba3d_fc49_4a24_b024_42917113edae.slice/crio-be39bdf31ef51869f4725af51097ef60df5466729bf400ff307ba6d592561bcc WatchSource:0}: Error finding container be39bdf31ef51869f4725af51097ef60df5466729bf400ff307ba6d592561bcc: Status 404 returned error can't find the container with id be39bdf31ef51869f4725af51097ef60df5466729bf400ff307ba6d592561bcc
Sep 18 16:22:09.496003 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:09.495957    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l" event={"ID":"b46dba3d-fc49-4a24-b024-42917113edae","Type":"ContainerStarted","Data":"be39bdf31ef51869f4725af51097ef60df5466729bf400ff307ba6d592561bcc"}
Sep 18 16:22:12.923337 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:12.923300    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:22:14.518269 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.518231    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l" event={"ID":"b46dba3d-fc49-4a24-b024-42917113edae","Type":"ContainerStarted","Data":"3ebf00059d61a7de42a9bc3068118d3d7418e934de7505a1dc4db708631a43f5"}
Sep 18 16:22:14.518693 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.518458    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:14.542766 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.542714    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l" podStartSLOduration=1.9455347189999999 podStartE2EDuration="6.542697085s" totalImagesPullingTime="4.597162366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:14.541271327 +0000 UTC m=+391.032227773" watchObservedRunningTime="2026-09-18 16:22:14.542697085 +0000 UTC m=+391.033653537"
Sep 18 16:22:14.985088 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.985058    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"]
Sep 18 16:22:14.988276 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.988254    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:14.991350 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.991329    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 18 16:22:14.991490 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.991330    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-jrfbn\""
Sep 18 16:22:14.991490 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.991328    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 18 16:22:14.999248 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:14.999226    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"]
Sep 18 16:22:15.140204 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.140170    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.140394 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.140219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/45e0d57d-319b-4778-a5c5-17c8eed656b4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.140394 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.140250    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4dps\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-kube-api-access-n4dps\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.241414 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.241317    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/45e0d57d-319b-4778-a5c5-17c8eed656b4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.241414 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.241362    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4dps\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-kube-api-access-n4dps\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.241414 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.241398    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.241713 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.241694    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/45e0d57d-319b-4778-a5c5-17c8eed656b4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.244061 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.244035    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.252054 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.252034    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4dps\" (UniqueName: \"kubernetes.io/projected/45e0d57d-319b-4778-a5c5-17c8eed656b4-kube-api-access-n4dps\") pod \"keda-metrics-apiserver-77857b7b98-rgh2f\" (UID: \"45e0d57d-319b-4778-a5c5-17c8eed656b4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.298653 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.298625    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:15.571382 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:15.571354    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"]
Sep 18 16:22:15.573311 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:22:15.573275    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e0d57d_319b_4778_a5c5_17c8eed656b4.slice/crio-2f0df7bbc748991aadf4adeabac95ff3919986aa673e4252245a12ff99100042 WatchSource:0}: Error finding container 2f0df7bbc748991aadf4adeabac95ff3919986aa673e4252245a12ff99100042: Status 404 returned error can't find the container with id 2f0df7bbc748991aadf4adeabac95ff3919986aa673e4252245a12ff99100042
Sep 18 16:22:16.526798 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:16.526765    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f" event={"ID":"45e0d57d-319b-4778-a5c5-17c8eed656b4","Type":"ContainerStarted","Data":"2f0df7bbc748991aadf4adeabac95ff3919986aa673e4252245a12ff99100042"}
Sep 18 16:22:19.540637 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:19.540594    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f" event={"ID":"45e0d57d-319b-4778-a5c5-17c8eed656b4","Type":"ContainerStarted","Data":"65ba6fc63a2801e42bd79d0cc7785c452a69163bb0bf3118f7294cf012f964a2"}
Sep 18 16:22:19.541118 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:19.540734    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:19.559963 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:19.559910    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f" podStartSLOduration=1.981465961 podStartE2EDuration="5.559893804s" totalImagesPullingTime="3.578427843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:19.558204058 +0000 UTC m=+396.049160510" watchObservedRunningTime="2026-09-18 16:22:19.559893804 +0000 UTC m=+396.050850255"
Sep 18 16:22:30.549754 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:30.549723    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-rgh2f"
Sep 18 16:22:35.524817 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:35.524779    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-hsl5l"
Sep 18 16:22:37.943989 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:37.943925    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dfdfdb477-j2k8h" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerName="console" containerID="cri-o://8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe" gracePeriod=15
Sep 18 16:22:38.017338 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.017306    2552 patch_prober.go:28] interesting pod/console-5dfdfdb477-j2k8h container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body=
Sep 18 16:22:38.017486 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.017370    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5dfdfdb477-j2k8h" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused"
Sep 18 16:22:38.197848 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.197786    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:22:38.234736 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234704    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhsz6\" (UniqueName: \"kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.234919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234756    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.234919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234789    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.234919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234825    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.234919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234854    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.234919 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234911    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.235232 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.234935    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config\") pod \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\" (UID: \"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0\") "
Sep 18 16:22:38.235394 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.235366    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:22:38.235468 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.235439    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config" (OuterVolumeSpecName: "console-config") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:22:38.235468 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.235451    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:22:38.235792 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.235758    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:22:38.237440 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.237403    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:22:38.237535 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.237492    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:22:38.237535 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.237500    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6" (OuterVolumeSpecName: "kube-api-access-bhsz6") pod "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" (UID: "74128f0c-cf76-4ec1-8ee9-c8ac95995fb0"). InnerVolumeSpecName "kube-api-access-bhsz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:22:38.335679 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335645    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-service-ca\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335679 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335670    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335679 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335685    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-oauth-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335699    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-serving-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335712    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-trusted-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335722    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-console-oauth-config\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.335953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.335730    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhsz6\" (UniqueName: \"kubernetes.io/projected/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0-kube-api-access-bhsz6\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:22:38.619319 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.619280    2552 generic.go:356] "Generic (PLEG): container finished" podID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerID="8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe" exitCode=0
Sep 18 16:22:38.619492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.619362    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfdfdb477-j2k8h"
Sep 18 16:22:38.619492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.619367    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdfdb477-j2k8h" event={"ID":"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0","Type":"ContainerDied","Data":"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"}
Sep 18 16:22:38.619492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.619444    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfdfdb477-j2k8h" event={"ID":"74128f0c-cf76-4ec1-8ee9-c8ac95995fb0","Type":"ContainerDied","Data":"a2f4bf44de6f2f1b417e94c49121f8706d6bd3046d015b4316f60be3cf73006c"}
Sep 18 16:22:38.619492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.619467    2552 scope.go:117] "RemoveContainer" containerID="8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"
Sep 18 16:22:38.628766 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.628747    2552 scope.go:117] "RemoveContainer" containerID="8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"
Sep 18 16:22:38.629066 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:22:38.629045    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe\": container with ID starting with 8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe not found: ID does not exist" containerID="8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"
Sep 18 16:22:38.629147 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.629072    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe"} err="failed to get container status \"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe\": rpc error: code = NotFound desc = could not find container \"8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe\": container with ID starting with 8dbf0102e7ba7526bde857242e81812c8d8d3ebbf54c1f08d2051c46efe39dbe not found: ID does not exist"
Sep 18 16:22:38.643731 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.643703    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:22:38.650351 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:38.650328    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfdfdb477-j2k8h"]
Sep 18 16:22:40.000359 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:22:40.000323    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" path="/var/lib/kubelet/pods/74128f0c-cf76-4ec1-8ee9-c8ac95995fb0/volumes"
Sep 18 16:23:32.626937 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.626899    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:23:32.627463 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.627307    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerName="console"
Sep 18 16:23:32.627463 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.627324    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerName="console"
Sep 18 16:23:32.627463 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.627395    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="74128f0c-cf76-4ec1-8ee9-c8ac95995fb0" containerName="console"
Sep 18 16:23:32.630230 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.630209    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.635056 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.635032    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-h7g9t\""
Sep 18 16:23:32.635177 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.635116    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 18 16:23:32.636195 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.636172    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 18 16:23:32.636316 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.636179    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 18 16:23:32.642648 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.642625    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:23:32.661660 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.661629    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-bnhrg"]
Sep 18 16:23:32.666370 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.666339    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.669240 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.669213    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 18 16:23:32.669389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.669276    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-dqqdl\""
Sep 18 16:23:32.675944 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.675920    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bnhrg"]
Sep 18 16:23:32.741491 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.741445    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.741683 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.741500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwbx\" (UniqueName: \"kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.842274 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.842233    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwbx\" (UniqueName: \"kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.842449 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.842292    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hck\" (UniqueName: \"kubernetes.io/projected/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-kube-api-access-j2hck\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.842449 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.842330    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.842449 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.842346    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-data\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.842449 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:23:32.842445    2552 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 18 16:23:32.842598 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:23:32.842506    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert podName:eb080a3b-6920-4022-9d5a-5313ecc50cdc nodeName:}" failed. No retries permitted until 2026-09-18 16:23:33.342488604 +0000 UTC m=+469.833445033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert") pod "kserve-controller-manager-7dcf4bff6-dvnrw" (UID: "eb080a3b-6920-4022-9d5a-5313ecc50cdc") : secret "kserve-webhook-server-cert" not found
Sep 18 16:23:32.854730 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.854693    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwbx\" (UniqueName: \"kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:32.943101 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.943011    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hck\" (UniqueName: \"kubernetes.io/projected/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-kube-api-access-j2hck\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.943101 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.943080    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-data\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.943426 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.943405    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-data\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.954596 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.954562    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hck\" (UniqueName: \"kubernetes.io/projected/0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1-kube-api-access-j2hck\") pod \"seaweedfs-64568bcd49-bnhrg\" (UID: \"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1\") " pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:32.976036 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:32.975964    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:33.247591 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.247555    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bnhrg"]
Sep 18 16:23:33.250856 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:23:33.250832    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc1f07a_9ed7_40c1_a479_6dc5f8e431e1.slice/crio-689673c1e2b62aad28f130b672630ccb0469118f7d83de8671cce2b138401943 WatchSource:0}: Error finding container 689673c1e2b62aad28f130b672630ccb0469118f7d83de8671cce2b138401943: Status 404 returned error can't find the container with id 689673c1e2b62aad28f130b672630ccb0469118f7d83de8671cce2b138401943
Sep 18 16:23:33.346529 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.346484    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:33.349123 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.349098    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") pod \"kserve-controller-manager-7dcf4bff6-dvnrw\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") " pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:33.540304 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.540211    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:33.812109 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.812017    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:23:33.836807 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:33.836741    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bnhrg" event={"ID":"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1","Type":"ContainerStarted","Data":"689673c1e2b62aad28f130b672630ccb0469118f7d83de8671cce2b138401943"}
Sep 18 16:23:33.929937 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:23:33.929898    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb080a3b_6920_4022_9d5a_5313ecc50cdc.slice/crio-642e86bbc01facca1d623a7ad86cc5bf5bec2b6646fe6d809684ca8b913ea110 WatchSource:0}: Error finding container 642e86bbc01facca1d623a7ad86cc5bf5bec2b6646fe6d809684ca8b913ea110: Status 404 returned error can't find the container with id 642e86bbc01facca1d623a7ad86cc5bf5bec2b6646fe6d809684ca8b913ea110
Sep 18 16:23:34.843628 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:34.843572    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" event={"ID":"eb080a3b-6920-4022-9d5a-5313ecc50cdc","Type":"ContainerStarted","Data":"642e86bbc01facca1d623a7ad86cc5bf5bec2b6646fe6d809684ca8b913ea110"}
Sep 18 16:23:37.857406 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.857303    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bnhrg" event={"ID":"0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1","Type":"ContainerStarted","Data":"b35a377b8bb989fe0b51b6a246d381bce89cc2b01eac7169bba135ca94d3da3c"}
Sep 18 16:23:37.857406 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.857369    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:23:37.858849 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.858823    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" event={"ID":"eb080a3b-6920-4022-9d5a-5313ecc50cdc","Type":"ContainerStarted","Data":"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"}
Sep 18 16:23:37.858964 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.858948    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:23:37.893873 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.893827    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-bnhrg" podStartSLOduration=1.608648147 podStartE2EDuration="5.893810985s" totalImagesPullingTime="4.285162838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:23:37.876580043 +0000 UTC m=+474.367536495" watchObservedRunningTime="2026-09-18 16:23:37.893810985 +0000 UTC m=+474.384767435"
Sep 18 16:23:37.894305 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:37.894281    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" podStartSLOduration=2.346764173 podStartE2EDuration="5.894273975s" totalImagesPullingTime="3.547509802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:23:37.892269656 +0000 UTC m=+474.383226107" watchObservedRunningTime="2026-09-18 16:23:37.894273975 +0000 UTC m=+474.385230426"
Sep 18 16:23:43.865061 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:23:43.865027    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-bnhrg"
Sep 18 16:24:08.868232 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:08.868198    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:24:15.202256 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.202214    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:24:15.202702 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.202432    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" podUID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" containerName="manager" containerID="cri-o://d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e" gracePeriod=10
Sep 18 16:24:15.222433 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.222395    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-6btnt"]
Sep 18 16:24:15.226886 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.226533    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.236220 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.236156    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-6btnt"]
Sep 18 16:24:15.359994 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.359936    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25tr\" (UniqueName: \"kubernetes.io/projected/5e48e3cb-8c24-477f-bd54-56f111dd0394-kube-api-access-d25tr\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.360164 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.360006    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e48e3cb-8c24-477f-bd54-56f111dd0394-cert\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.445487 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.445457    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:24:15.460692 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.460639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d25tr\" (UniqueName: \"kubernetes.io/projected/5e48e3cb-8c24-477f-bd54-56f111dd0394-kube-api-access-d25tr\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.460692 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.460669    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e48e3cb-8c24-477f-bd54-56f111dd0394-cert\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.462913 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.462878    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e48e3cb-8c24-477f-bd54-56f111dd0394-cert\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.470902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.470877    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25tr\" (UniqueName: \"kubernetes.io/projected/5e48e3cb-8c24-477f-bd54-56f111dd0394-kube-api-access-d25tr\") pod \"kserve-controller-manager-7dcf4bff6-6btnt\" (UID: \"5e48e3cb-8c24-477f-bd54-56f111dd0394\") " pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.561585 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.561539    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szwbx\" (UniqueName: \"kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx\") pod \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") "
Sep 18 16:24:15.561793 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.561604    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") pod \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\" (UID: \"eb080a3b-6920-4022-9d5a-5313ecc50cdc\") "
Sep 18 16:24:15.563832 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.563796    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert" (OuterVolumeSpecName: "cert") pod "eb080a3b-6920-4022-9d5a-5313ecc50cdc" (UID: "eb080a3b-6920-4022-9d5a-5313ecc50cdc"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:24:15.563944 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.563834    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx" (OuterVolumeSpecName: "kube-api-access-szwbx") pod "eb080a3b-6920-4022-9d5a-5313ecc50cdc" (UID: "eb080a3b-6920-4022-9d5a-5313ecc50cdc"). InnerVolumeSpecName "kube-api-access-szwbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 16:24:15.576046 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.576015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:15.662831 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.662796    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwbx\" (UniqueName: \"kubernetes.io/projected/eb080a3b-6920-4022-9d5a-5313ecc50cdc-kube-api-access-szwbx\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:24:15.662831 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.662824    2552 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb080a3b-6920-4022-9d5a-5313ecc50cdc-cert\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:24:15.848556 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.848519    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-6btnt"]
Sep 18 16:24:15.852489 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:24:15.852460    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e48e3cb_8c24_477f_bd54_56f111dd0394.slice/crio-e402a8bf36f92c660dfbe5e2c3950cf792e371ee69892ff3b0fcc5b7dd02d180 WatchSource:0}: Error finding container e402a8bf36f92c660dfbe5e2c3950cf792e371ee69892ff3b0fcc5b7dd02d180: Status 404 returned error can't find the container with id e402a8bf36f92c660dfbe5e2c3950cf792e371ee69892ff3b0fcc5b7dd02d180
Sep 18 16:24:15.999318 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999282    2552 generic.go:356] "Generic (PLEG): container finished" podID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" containerID="d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e" exitCode=0
Sep 18 16:24:15.999511 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999352    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw"
Sep 18 16:24:15.999868 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999844    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt" event={"ID":"5e48e3cb-8c24-477f-bd54-56f111dd0394","Type":"ContainerStarted","Data":"e402a8bf36f92c660dfbe5e2c3950cf792e371ee69892ff3b0fcc5b7dd02d180"}
Sep 18 16:24:15.999988 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999890    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" event={"ID":"eb080a3b-6920-4022-9d5a-5313ecc50cdc","Type":"ContainerDied","Data":"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"}
Sep 18 16:24:15.999988 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999927    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-dvnrw" event={"ID":"eb080a3b-6920-4022-9d5a-5313ecc50cdc","Type":"ContainerDied","Data":"642e86bbc01facca1d623a7ad86cc5bf5bec2b6646fe6d809684ca8b913ea110"}
Sep 18 16:24:15.999988 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:15.999957    2552 scope.go:117] "RemoveContainer" containerID="d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"
Sep 18 16:24:16.008133 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:16.008096    2552 scope.go:117] "RemoveContainer" containerID="d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"
Sep 18 16:24:16.008461 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:24:16.008440    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e\": container with ID starting with d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e not found: ID does not exist" containerID="d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"
Sep 18 16:24:16.008530 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:16.008471    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e"} err="failed to get container status \"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e\": rpc error: code = NotFound desc = could not find container \"d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e\": container with ID starting with d0eba22695ed943bae2ac395353ffb49b749fbc0f5462e07d65f8fdf7bcf630e not found: ID does not exist"
Sep 18 16:24:16.023893 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:16.023864    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:24:16.029870 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:16.029845    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-dvnrw"]
Sep 18 16:24:17.005119 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:17.005073    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt" event={"ID":"5e48e3cb-8c24-477f-bd54-56f111dd0394","Type":"ContainerStarted","Data":"86b0671d453ff00b9dadf8539b8ffc30e66fa8a104ab590163e3bf63dfd7e9ec"}
Sep 18 16:24:17.005596 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:17.005189    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:17.023520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:17.023465    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt" podStartSLOduration=1.606388631 podStartE2EDuration="2.023449855s" totalImagesPullingTime="417.061224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:24:17.022593977 +0000 UTC m=+513.513550424" watchObservedRunningTime="2026-09-18 16:24:17.023449855 +0000 UTC m=+513.514406362"
Sep 18 16:24:17.999982 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:17.999941    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" path="/var/lib/kubelet/pods/eb080a3b-6920-4022-9d5a-5313ecc50cdc/volumes"
Sep 18 16:24:48.014943 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:48.014912    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf4bff6-6btnt"
Sep 18 16:24:49.311809 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.311773    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-wbnmr"]
Sep 18 16:24:49.312287 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.312211    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" containerName="manager"
Sep 18 16:24:49.312287 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.312226    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" containerName="manager"
Sep 18 16:24:49.312396 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.312298    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb080a3b-6920-4022-9d5a-5313ecc50cdc" containerName="manager"
Sep 18 16:24:49.316422 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.316399    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:49.319457 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.319433    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Sep 18 16:24:49.319647 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.319623    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-4wbsb\""
Sep 18 16:24:49.326616 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.326590    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-wbnmr"]
Sep 18 16:24:49.400816 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.400793    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:49.400948 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.400821    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcr9v\" (UniqueName: \"kubernetes.io/projected/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-kube-api-access-mcr9v\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:49.501566 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.501532    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:49.501686 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.501573    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcr9v\" (UniqueName: \"kubernetes.io/projected/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-kube-api-access-mcr9v\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:49.501728 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:24:49.501689    2552 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 18 16:24:49.501786 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:24:49.501775    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs podName:c05a3a35-70e5-4bfd-84ad-4342b27b47c9 nodeName:}" failed. No retries permitted until 2026-09-18 16:24:50.00175325 +0000 UTC m=+546.492709684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs") pod "model-serving-api-7b954ffc95-wbnmr" (UID: "c05a3a35-70e5-4bfd-84ad-4342b27b47c9") : secret "model-serving-api-tls" not found
Sep 18 16:24:49.510943 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:49.510918    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcr9v\" (UniqueName: \"kubernetes.io/projected/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-kube-api-access-mcr9v\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:50.005625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:50.005595    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:50.007763 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:50.007746    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c05a3a35-70e5-4bfd-84ad-4342b27b47c9-tls-certs\") pod \"model-serving-api-7b954ffc95-wbnmr\" (UID: \"c05a3a35-70e5-4bfd-84ad-4342b27b47c9\") " pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:50.228327 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:50.228297    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:50.495353 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:50.495330    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-wbnmr"]
Sep 18 16:24:50.498069 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:24:50.498039    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05a3a35_70e5_4bfd_84ad_4342b27b47c9.slice/crio-6b5af3c428956ae8f85ca530c177ca04594846811eccddc47aaff9c74baad0e2 WatchSource:0}: Error finding container 6b5af3c428956ae8f85ca530c177ca04594846811eccddc47aaff9c74baad0e2: Status 404 returned error can't find the container with id 6b5af3c428956ae8f85ca530c177ca04594846811eccddc47aaff9c74baad0e2
Sep 18 16:24:51.137964 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:51.137839    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-wbnmr" event={"ID":"c05a3a35-70e5-4bfd-84ad-4342b27b47c9","Type":"ContainerStarted","Data":"6b5af3c428956ae8f85ca530c177ca04594846811eccddc47aaff9c74baad0e2"}
Sep 18 16:24:53.147742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:53.147660    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-wbnmr" event={"ID":"c05a3a35-70e5-4bfd-84ad-4342b27b47c9","Type":"ContainerStarted","Data":"8c34f8bfa18044c47e23faeeff3376252c8c9fca05ca5009fd14fc6d81a13d9b"}
Sep 18 16:24:53.147742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:53.147722    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:24:53.166807 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:24:53.166765    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-wbnmr" podStartSLOduration=1.880016473 podStartE2EDuration="4.166751089s" totalImagesPullingTime="2.286734616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:24:53.165539591 +0000 UTC m=+549.656496041" watchObservedRunningTime="2026-09-18 16:24:53.166751089 +0000 UTC m=+549.657707538"
Sep 18 16:25:04.156537 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:25:04.156506    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-wbnmr"
Sep 18 16:25:43.894817 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:25:43.894789    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:25:43.897813 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:25:43.897795    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:28:07.167208 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.167165    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:07.170306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.170285    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.172848 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.172820    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-191f9-serving-cert\""
Sep 18 16:28:07.173005 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.172989    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z57rx\""
Sep 18 16:28:07.173068 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.173016    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 16:28:07.173068 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.173016    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-191f9-kube-rbac-proxy-sar-config\""
Sep 18 16:28:07.180522 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.180500    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:07.310991 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.310942    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.311173 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.311013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.412321 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.412277    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.412508 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.412329    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.412508 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:28:07.412431    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-191f9-serving-cert: secret "switch-graph-191f9-serving-cert" not found
Sep 18 16:28:07.412581 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:28:07.412512    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls podName:68cb5412-9cb2-4cf8-9ab6-98467eea14f1 nodeName:}" failed. No retries permitted until 2026-09-18 16:28:07.912491328 +0000 UTC m=+744.403447757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls") pod "switch-graph-191f9-58b7f9f45-q6mtt" (UID: "68cb5412-9cb2-4cf8-9ab6-98467eea14f1") : secret "switch-graph-191f9-serving-cert" not found
Sep 18 16:28:07.413044 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.413028    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.915270 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.915240    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:07.917616 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:07.917597    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") pod \"switch-graph-191f9-58b7f9f45-q6mtt\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") " pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:08.080742 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:08.080713    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:08.351662 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:08.351479    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:08.353861 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:28:08.353831    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cb5412_9cb2_4cf8_9ab6_98467eea14f1.slice/crio-6234f595e63b73f8796dd119b282551fb1e8b834d673b085d79cdaf918016060 WatchSource:0}: Error finding container 6234f595e63b73f8796dd119b282551fb1e8b834d673b085d79cdaf918016060: Status 404 returned error can't find the container with id 6234f595e63b73f8796dd119b282551fb1e8b834d673b085d79cdaf918016060
Sep 18 16:28:08.355844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:08.355829    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 16:28:08.910776 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:08.910738    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" event={"ID":"68cb5412-9cb2-4cf8-9ab6-98467eea14f1","Type":"ContainerStarted","Data":"6234f595e63b73f8796dd119b282551fb1e8b834d673b085d79cdaf918016060"}
Sep 18 16:28:10.920097 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:10.920057    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" event={"ID":"68cb5412-9cb2-4cf8-9ab6-98467eea14f1","Type":"ContainerStarted","Data":"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"}
Sep 18 16:28:10.920540 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:10.920196    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:10.938753 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:10.938686    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podStartSLOduration=1.5722748050000002 podStartE2EDuration="3.938673481s" totalImagesPullingTime="2.366398676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:28:10.937694858 +0000 UTC m=+747.428651306" watchObservedRunningTime="2026-09-18 16:28:10.938673481 +0000 UTC m=+747.429629930"
Sep 18 16:28:16.930732 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:16.930701    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:18.293021 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:18.292964    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:18.293483 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:18.293229    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" containerID="cri-o://26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781" gracePeriod=30
Sep 18 16:28:21.929109 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:21.929071    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:26.928780 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:26.928731    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:31.929277 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:31.929235    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:31.929755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:31.929353    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:36.928782 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:36.928742    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:41.929491 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:41.929454    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:46.929174 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:46.929129    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:28:47.214564 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.214489    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:28:47.222144 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.222116    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.227709 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.227682    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Sep 18 16:28:47.227910 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.227690    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Sep 18 16:28:47.248954 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.248927    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:28:47.316128 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.316094    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.316292 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.316158    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.417023 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.416991    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.417217 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.417054    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.417714 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.417684    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.419357 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.419336    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls\") pod \"model-chainer-7bcc66cdd8-fd944\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.532834 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.532802    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:47.804953 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:47.804876    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:28:47.808151 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:28:47.808118    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0561d2f9_4ade_479c_a95a_d5e1cd746f2f.slice/crio-adffed5343d3fd762bb2da30d5a5c67ad68173a1bddcbc1318ebc4b08c4c1eb8 WatchSource:0}: Error finding container adffed5343d3fd762bb2da30d5a5c67ad68173a1bddcbc1318ebc4b08c4c1eb8: Status 404 returned error can't find the container with id adffed5343d3fd762bb2da30d5a5c67ad68173a1bddcbc1318ebc4b08c4c1eb8
Sep 18 16:28:48.065763 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.065666    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" event={"ID":"0561d2f9-4ade-479c-a95a-d5e1cd746f2f","Type":"ContainerStarted","Data":"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"}
Sep 18 16:28:48.065763 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.065717    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" event={"ID":"0561d2f9-4ade-479c-a95a-d5e1cd746f2f","Type":"ContainerStarted","Data":"adffed5343d3fd762bb2da30d5a5c67ad68173a1bddcbc1318ebc4b08c4c1eb8"}
Sep 18 16:28:48.066260 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.065806    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:48.083150 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.083098    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podStartSLOduration=1.083084645 podStartE2EDuration="1.083084645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:28:48.081709568 +0000 UTC m=+784.572666018" watchObservedRunningTime="2026-09-18 16:28:48.083084645 +0000 UTC m=+784.574041094"
Sep 18 16:28:48.437339 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.437315    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:48.525772 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.525738    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") pod \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") "
Sep 18 16:28:48.525917 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.525791    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle\") pod \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\" (UID: \"68cb5412-9cb2-4cf8-9ab6-98467eea14f1\") "
Sep 18 16:28:48.526206 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.526184    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "68cb5412-9cb2-4cf8-9ab6-98467eea14f1" (UID: "68cb5412-9cb2-4cf8-9ab6-98467eea14f1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:28:48.527918 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.527896    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "68cb5412-9cb2-4cf8-9ab6-98467eea14f1" (UID: "68cb5412-9cb2-4cf8-9ab6-98467eea14f1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:28:48.626747 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.626657    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:28:48.626747 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:48.626698    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68cb5412-9cb2-4cf8-9ab6-98467eea14f1-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:28:49.071211 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.071178    2552 generic.go:356] "Generic (PLEG): container finished" podID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerID="26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781" exitCode=0
Sep 18 16:28:49.071626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.071224    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"
Sep 18 16:28:49.071626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.071255    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" event={"ID":"68cb5412-9cb2-4cf8-9ab6-98467eea14f1","Type":"ContainerDied","Data":"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"}
Sep 18 16:28:49.071626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.071307    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt" event={"ID":"68cb5412-9cb2-4cf8-9ab6-98467eea14f1","Type":"ContainerDied","Data":"6234f595e63b73f8796dd119b282551fb1e8b834d673b085d79cdaf918016060"}
Sep 18 16:28:49.071626 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.071331    2552 scope.go:117] "RemoveContainer" containerID="26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"
Sep 18 16:28:49.079389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.079371    2552 scope.go:117] "RemoveContainer" containerID="26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"
Sep 18 16:28:49.079634 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:28:49.079616    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781\": container with ID starting with 26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781 not found: ID does not exist" containerID="26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"
Sep 18 16:28:49.079698 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.079640    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781"} err="failed to get container status \"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781\": rpc error: code = NotFound desc = could not find container \"26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781\": container with ID starting with 26329a53a79d16b4744d2a8f3837d0dde4af7f014318f99d332a6dbfaa844781 not found: ID does not exist"
Sep 18 16:28:49.092921 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.092899    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:49.097290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:49.097270    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt"]
Sep 18 16:28:50.000442 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:50.000407    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" path="/var/lib/kubelet/pods/68cb5412-9cb2-4cf8-9ab6-98467eea14f1/volumes"
Sep 18 16:28:54.076787 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:54.076754    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:28:58.795182 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:58.795144    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:28:58.795629 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:58.795345    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" containerID="cri-o://b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095" gracePeriod=30
Sep 18 16:28:59.075077 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:28:59.074993    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:04.074902 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:04.074864    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:09.074952 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:09.074864    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:09.075337 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:09.074995    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:29:14.075446 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:14.075403    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:19.075815 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:19.075771    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:24.075443 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:24.075401    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:29:28.576886 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.576849    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:29:28.577326 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.577309    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9"
Sep 18 16:29:28.577400 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.577329    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9"
Sep 18 16:29:28.577464 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.577441    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="68cb5412-9cb2-4cf8-9ab6-98467eea14f1" containerName="switch-graph-191f9"
Sep 18 16:29:28.580645 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.580624    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.583550 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.583523    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-8aa04-kube-rbac-proxy-sar-config\""
Sep 18 16:29:28.583669 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.583526    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-8aa04-serving-cert\""
Sep 18 16:29:28.591291 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.591266    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:29:28.734910 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.734872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.735110 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.734924    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.835647 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.835570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.835647 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.835618    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.835836 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:29:28.835759    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-8aa04-serving-cert: secret "switch-graph-8aa04-serving-cert" not found
Sep 18 16:29:28.835890 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:29:28.835859    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls podName:567b00dd-701a-4510-8f0d-08117c3dd4a4 nodeName:}" failed. No retries permitted until 2026-09-18 16:29:29.335835519 +0000 UTC m=+825.826791955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls") pod "switch-graph-8aa04-785cbdc5c8-rrcvw" (UID: "567b00dd-701a-4510-8f0d-08117c3dd4a4") : secret "switch-graph-8aa04-serving-cert" not found
Sep 18 16:29:28.836399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.836367    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:28.943194 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:28.943166    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:29:29.037402 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.037363    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle\") pod \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") "
Sep 18 16:29:29.037605 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.037506    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls\") pod \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\" (UID: \"0561d2f9-4ade-479c-a95a-d5e1cd746f2f\") "
Sep 18 16:29:29.037800 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.037775    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0561d2f9-4ade-479c-a95a-d5e1cd746f2f" (UID: "0561d2f9-4ade-479c-a95a-d5e1cd746f2f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:29:29.039460 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.039439    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0561d2f9-4ade-479c-a95a-d5e1cd746f2f" (UID: "0561d2f9-4ade-479c-a95a-d5e1cd746f2f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:29:29.138443 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.138367    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:29:29.138443 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.138394    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0561d2f9-4ade-479c-a95a-d5e1cd746f2f-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:29:29.239235 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.239197    2552 generic.go:356] "Generic (PLEG): container finished" podID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerID="b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095" exitCode=137
Sep 18 16:29:29.239395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.239242    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"
Sep 18 16:29:29.239395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.239249    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" event={"ID":"0561d2f9-4ade-479c-a95a-d5e1cd746f2f","Type":"ContainerDied","Data":"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"}
Sep 18 16:29:29.239395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.239315    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944" event={"ID":"0561d2f9-4ade-479c-a95a-d5e1cd746f2f","Type":"ContainerDied","Data":"adffed5343d3fd762bb2da30d5a5c67ad68173a1bddcbc1318ebc4b08c4c1eb8"}
Sep 18 16:29:29.239395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.239337    2552 scope.go:117] "RemoveContainer" containerID="b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"
Sep 18 16:29:29.248102 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.248086    2552 scope.go:117] "RemoveContainer" containerID="b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"
Sep 18 16:29:29.248388 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:29:29.248368    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095\": container with ID starting with b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095 not found: ID does not exist" containerID="b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"
Sep 18 16:29:29.248456 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.248399    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095"} err="failed to get container status \"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095\": rpc error: code = NotFound desc = could not find container \"b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095\": container with ID starting with b098aa53c1e6f667c60ba401cef865d2f852af340dde42ec094a271bb426d095 not found: ID does not exist"
Sep 18 16:29:29.260997 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.260953    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:29:29.263816 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.263795    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944"]
Sep 18 16:29:29.339957 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.339926    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:29.342314 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.342292    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") pod \"switch-graph-8aa04-785cbdc5c8-rrcvw\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") " pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:29.492088 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.492045    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:29.773393 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:29.773309    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:29:29.777171 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:29:29.777141    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567b00dd_701a_4510_8f0d_08117c3dd4a4.slice/crio-ab73e666849834e59160d23ed3ec1ed6152a0ed0c09b71118d78b05d5fd9412f WatchSource:0}: Error finding container ab73e666849834e59160d23ed3ec1ed6152a0ed0c09b71118d78b05d5fd9412f: Status 404 returned error can't find the container with id ab73e666849834e59160d23ed3ec1ed6152a0ed0c09b71118d78b05d5fd9412f
Sep 18 16:29:30.000088 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:30.000052    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" path="/var/lib/kubelet/pods/0561d2f9-4ade-479c-a95a-d5e1cd746f2f/volumes"
Sep 18 16:29:30.244458 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:30.244424    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" event={"ID":"567b00dd-701a-4510-8f0d-08117c3dd4a4","Type":"ContainerStarted","Data":"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"}
Sep 18 16:29:30.244646 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:30.244477    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" event={"ID":"567b00dd-701a-4510-8f0d-08117c3dd4a4","Type":"ContainerStarted","Data":"ab73e666849834e59160d23ed3ec1ed6152a0ed0c09b71118d78b05d5fd9412f"}
Sep 18 16:29:30.244646 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:30.244504    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:29:30.263179 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:30.263124    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podStartSLOduration=2.263108899 podStartE2EDuration="2.263108899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:29:30.261267563 +0000 UTC m=+826.752224014" watchObservedRunningTime="2026-09-18 16:29:30.263108899 +0000 UTC m=+826.754065394"
Sep 18 16:29:36.255490 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:29:36.255459    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:30:09.017720 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.017678    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:30:09.018245 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.017959    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer"
Sep 18 16:30:09.018245 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.017970    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer"
Sep 18 16:30:09.018245 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.018042    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0561d2f9-4ade-479c-a95a-d5e1cd746f2f" containerName="model-chainer"
Sep 18 16:30:09.022264 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.022242    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.026519 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.026494    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8d780-serving-cert\""
Sep 18 16:30:09.026836 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.026817    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8d780-kube-rbac-proxy-sar-config\""
Sep 18 16:30:09.033556 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.033534    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:30:09.138197 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.138157    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.138197 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.138203    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.238948 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.238909    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.238948 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.238954    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.239555 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.239536    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.241335 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.241315    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls\") pod \"sequence-graph-8d780-567975d654-5cz79\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") " pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.332083 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.331968    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:09.605882 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:09.605674    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:30:09.608530 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:30:09.608497    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec122de_f489_46ae_8b0e_358868fbca71.slice/crio-5b45daa925f7fdbe773ad0d2bdda33574411add436468fc32ae67d3d6c06c4e4 WatchSource:0}: Error finding container 5b45daa925f7fdbe773ad0d2bdda33574411add436468fc32ae67d3d6c06c4e4: Status 404 returned error can't find the container with id 5b45daa925f7fdbe773ad0d2bdda33574411add436468fc32ae67d3d6c06c4e4
Sep 18 16:30:10.424389 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:10.424351    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" event={"ID":"0ec122de-f489-46ae-8b0e-358868fbca71","Type":"ContainerStarted","Data":"7abd04d6a97961ff1f3f73da16dbc4f72f47a39dac00627046b99288dd1502e8"}
Sep 18 16:30:10.424860 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:10.424409    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" event={"ID":"0ec122de-f489-46ae-8b0e-358868fbca71","Type":"ContainerStarted","Data":"5b45daa925f7fdbe773ad0d2bdda33574411add436468fc32ae67d3d6c06c4e4"}
Sep 18 16:30:10.424860 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:10.424485    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:10.447823 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:10.447771    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podStartSLOduration=2.447757818 podStartE2EDuration="2.447757818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:30:10.447486154 +0000 UTC m=+866.938442604" watchObservedRunningTime="2026-09-18 16:30:10.447757818 +0000 UTC m=+866.938714264"
Sep 18 16:30:16.439363 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:16.439331    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:30:43.919943 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:43.919864    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:30:43.920515 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:30:43.920449    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:35:43.943928 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:35:43.943898    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:35:43.944436 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:35:43.944375    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:37:43.402184 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:43.402145    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:37:43.404652 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:43.402407    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" containerID="cri-o://fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb" gracePeriod=30
Sep 18 16:37:46.253890 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:46.253847    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:37:51.252859 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:51.252812    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:37:56.253387 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:56.253343    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:37:56.253770 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:37:56.253460    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:38:01.253159 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:01.253117    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:06.253027 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:06.252923    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:11.252841 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:11.252794    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:14.050165 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.050139    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:38:14.100769 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.100732    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle\") pod \"567b00dd-701a-4510-8f0d-08117c3dd4a4\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") "
Sep 18 16:38:14.100935 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.100846    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") pod \"567b00dd-701a-4510-8f0d-08117c3dd4a4\" (UID: \"567b00dd-701a-4510-8f0d-08117c3dd4a4\") "
Sep 18 16:38:14.101188 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.101156    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "567b00dd-701a-4510-8f0d-08117c3dd4a4" (UID: "567b00dd-701a-4510-8f0d-08117c3dd4a4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:38:14.102894 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.102868    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "567b00dd-701a-4510-8f0d-08117c3dd4a4" (UID: "567b00dd-701a-4510-8f0d-08117c3dd4a4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:38:14.202319 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.202228    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/567b00dd-701a-4510-8f0d-08117c3dd4a4-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:38:14.202319 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.202261    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/567b00dd-701a-4510-8f0d-08117c3dd4a4-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:38:14.407290 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.407252    2552 generic.go:356] "Generic (PLEG): container finished" podID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerID="fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb" exitCode=0
Sep 18 16:38:14.407456 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.407305    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"
Sep 18 16:38:14.407456 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.407305    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" event={"ID":"567b00dd-701a-4510-8f0d-08117c3dd4a4","Type":"ContainerDied","Data":"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"}
Sep 18 16:38:14.407456 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.407447    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw" event={"ID":"567b00dd-701a-4510-8f0d-08117c3dd4a4","Type":"ContainerDied","Data":"ab73e666849834e59160d23ed3ec1ed6152a0ed0c09b71118d78b05d5fd9412f"}
Sep 18 16:38:14.407562 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.407479    2552 scope.go:117] "RemoveContainer" containerID="fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"
Sep 18 16:38:14.415697 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.415678    2552 scope.go:117] "RemoveContainer" containerID="fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"
Sep 18 16:38:14.415971 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:38:14.415952    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb\": container with ID starting with fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb not found: ID does not exist" containerID="fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"
Sep 18 16:38:14.416076 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.415992    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb"} err="failed to get container status \"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb\": rpc error: code = NotFound desc = could not find container \"fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb\": container with ID starting with fb49090402a868225a6d539c8ae1412c76b5fe5351cbbee58638518dee265afb not found: ID does not exist"
Sep 18 16:38:14.430174 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.430149    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:38:14.434150 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:14.434128    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw"]
Sep 18 16:38:15.999658 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:15.999612    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" path="/var/lib/kubelet/pods/567b00dd-701a-4510-8f0d-08117c3dd4a4/volumes"
Sep 18 16:38:24.514304 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:24.514264    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:38:24.514727 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:24.514489    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" containerID="cri-o://7abd04d6a97961ff1f3f73da16dbc4f72f47a39dac00627046b99288dd1502e8" gracePeriod=30
Sep 18 16:38:26.437207 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:26.437163    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:31.437395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:31.437346    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:36.437821 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:36.437777    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:36.438398 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:36.437901    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:38:41.437658 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:41.437613    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:46.437624 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:46.437578    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:51.438257 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:51.438210    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:38:53.656991 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.656893    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:38:53.657349 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.657211    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04"
Sep 18 16:38:53.657349 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.657224    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04"
Sep 18 16:38:53.657349 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.657273    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="567b00dd-701a-4510-8f0d-08117c3dd4a4" containerName="switch-graph-8aa04"
Sep 18 16:38:53.660911 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.660887    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:53.664075 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.664029    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-6304f-serving-cert\""
Sep 18 16:38:53.664272 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.664091    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-6304f-kube-rbac-proxy-sar-config\""
Sep 18 16:38:53.671155 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.671128    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:38:53.714352 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.714313    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:53.714517 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.714370    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:53.814788 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.814744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:53.815021 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.814824    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:53.815021 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:38:53.814896    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-6304f-serving-cert: secret "ensemble-graph-6304f-serving-cert" not found
Sep 18 16:38:53.815021 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:38:53.814972    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls podName:d36fe325-e6e4-464a-876a-5eefa53603ef nodeName:}" failed. No retries permitted until 2026-09-18 16:38:54.314952774 +0000 UTC m=+1390.805909208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls") pod "ensemble-graph-6304f-66c85585fd-jtg67" (UID: "d36fe325-e6e4-464a-876a-5eefa53603ef") : secret "ensemble-graph-6304f-serving-cert" not found
Sep 18 16:38:53.815680 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:53.815658    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:54.317844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.317789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:54.320274 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.320248    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") pod \"ensemble-graph-6304f-66c85585fd-jtg67\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") " pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:54.571266 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.571189    2552 generic.go:356] "Generic (PLEG): container finished" podID="0ec122de-f489-46ae-8b0e-358868fbca71" containerID="7abd04d6a97961ff1f3f73da16dbc4f72f47a39dac00627046b99288dd1502e8" exitCode=0
Sep 18 16:38:54.571266 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.571237    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" event={"ID":"0ec122de-f489-46ae-8b0e-358868fbca71","Type":"ContainerDied","Data":"7abd04d6a97961ff1f3f73da16dbc4f72f47a39dac00627046b99288dd1502e8"}
Sep 18 16:38:54.572269 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.572247    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:54.675196 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.675166    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:38:54.720577 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.720536    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls\") pod \"0ec122de-f489-46ae-8b0e-358868fbca71\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") "
Sep 18 16:38:54.720577 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.720581    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle\") pod \"0ec122de-f489-46ae-8b0e-358868fbca71\" (UID: \"0ec122de-f489-46ae-8b0e-358868fbca71\") "
Sep 18 16:38:54.721017 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.720972    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0ec122de-f489-46ae-8b0e-358868fbca71" (UID: "0ec122de-f489-46ae-8b0e-358868fbca71"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:38:54.722755 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.722726    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0ec122de-f489-46ae-8b0e-358868fbca71" (UID: "0ec122de-f489-46ae-8b0e-358868fbca71"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:38:54.821516 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.821433    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0ec122de-f489-46ae-8b0e-358868fbca71-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:38:54.821516 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.821462    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec122de-f489-46ae-8b0e-358868fbca71-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:38:54.847998 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:54.847940    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:38:54.850913 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:38:54.850885    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36fe325_e6e4_464a_876a_5eefa53603ef.slice/crio-e6744f1b0d46b4cd51c4770b3e5334ace1aec2d5cf666d0e5f227a44bcf3f11a WatchSource:0}: Error finding container e6744f1b0d46b4cd51c4770b3e5334ace1aec2d5cf666d0e5f227a44bcf3f11a: Status 404 returned error can't find the container with id e6744f1b0d46b4cd51c4770b3e5334ace1aec2d5cf666d0e5f227a44bcf3f11a
Sep 18 16:38:55.577005 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.576873    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" event={"ID":"d36fe325-e6e4-464a-876a-5eefa53603ef","Type":"ContainerStarted","Data":"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"}
Sep 18 16:38:55.577206 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.577042    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:38:55.577206 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.577087    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" event={"ID":"d36fe325-e6e4-464a-876a-5eefa53603ef","Type":"ContainerStarted","Data":"e6744f1b0d46b4cd51c4770b3e5334ace1aec2d5cf666d0e5f227a44bcf3f11a"}
Sep 18 16:38:55.578302 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.578279    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"
Sep 18 16:38:55.578415 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.578278    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79" event={"ID":"0ec122de-f489-46ae-8b0e-358868fbca71","Type":"ContainerDied","Data":"5b45daa925f7fdbe773ad0d2bdda33574411add436468fc32ae67d3d6c06c4e4"}
Sep 18 16:38:55.578415 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.578409    2552 scope.go:117] "RemoveContainer" containerID="7abd04d6a97961ff1f3f73da16dbc4f72f47a39dac00627046b99288dd1502e8"
Sep 18 16:38:55.593957 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.593908    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podStartSLOduration=2.5938911129999997 podStartE2EDuration="2.593891113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:38:55.593052077 +0000 UTC m=+1392.084008527" watchObservedRunningTime="2026-09-18 16:38:55.593891113 +0000 UTC m=+1392.084847564"
Sep 18 16:38:55.607126 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.607091    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:38:55.611204 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:55.611177    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79"]
Sep 18 16:38:56.000563 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:38:56.000527    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" path="/var/lib/kubelet/pods/0ec122de-f489-46ae-8b0e-358868fbca71/volumes"
Sep 18 16:39:01.590092 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:01.590046    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:39:04.245125 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:04.245090    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:39:04.245583 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:04.245294    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" containerID="cri-o://1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2" gracePeriod=30
Sep 18 16:39:06.588887 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:06.588840    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:11.588496 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:11.588454    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:16.588520 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:16.588479    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:16.588925 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:16.588591    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:39:21.588257 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:21.588215    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:26.589404 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:26.589359    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:31.588724 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:31.588687    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:34.394699 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.394671    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:39:34.531309 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.531227    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") pod \"d36fe325-e6e4-464a-876a-5eefa53603ef\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") "
Sep 18 16:39:34.531309 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.531266    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle\") pod \"d36fe325-e6e4-464a-876a-5eefa53603ef\" (UID: \"d36fe325-e6e4-464a-876a-5eefa53603ef\") "
Sep 18 16:39:34.531648 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.531624    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d36fe325-e6e4-464a-876a-5eefa53603ef" (UID: "d36fe325-e6e4-464a-876a-5eefa53603ef"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:39:34.533273 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.533246    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d36fe325-e6e4-464a-876a-5eefa53603ef" (UID: "d36fe325-e6e4-464a-876a-5eefa53603ef"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:39:34.632563 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.632527    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d36fe325-e6e4-464a-876a-5eefa53603ef-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:39:34.632563 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.632553    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36fe325-e6e4-464a-876a-5eefa53603ef-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:39:34.746150 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.746111    2552 generic.go:356] "Generic (PLEG): container finished" podID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerID="1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2" exitCode=0
Sep 18 16:39:34.746306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.746164    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"
Sep 18 16:39:34.746306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.746185    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" event={"ID":"d36fe325-e6e4-464a-876a-5eefa53603ef","Type":"ContainerDied","Data":"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"}
Sep 18 16:39:34.746306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.746261    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67" event={"ID":"d36fe325-e6e4-464a-876a-5eefa53603ef","Type":"ContainerDied","Data":"e6744f1b0d46b4cd51c4770b3e5334ace1aec2d5cf666d0e5f227a44bcf3f11a"}
Sep 18 16:39:34.746306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.746283    2552 scope.go:117] "RemoveContainer" containerID="1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"
Sep 18 16:39:34.750711 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.750685    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:39:34.751140 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751116    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f"
Sep 18 16:39:34.751140 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751143    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f"
Sep 18 16:39:34.751330 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751162    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780"
Sep 18 16:39:34.751330 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751171    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780"
Sep 18 16:39:34.751330 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751249    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec122de-f489-46ae-8b0e-358868fbca71" containerName="sequence-graph-8d780"
Sep 18 16:39:34.751330 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.751262    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" containerName="ensemble-graph-6304f"
Sep 18 16:39:34.754675 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.754652    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.755282 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.755265    2552 scope.go:117] "RemoveContainer" containerID="1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"
Sep 18 16:39:34.755646 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:39:34.755614    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2\": container with ID starting with 1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2 not found: ID does not exist" containerID="1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"
Sep 18 16:39:34.755725 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.755662    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2"} err="failed to get container status \"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2\": rpc error: code = NotFound desc = could not find container \"1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2\": container with ID starting with 1fe007baea377c46973e07f498c03c342b40c02633d290f1ca9b683640b412d2 not found: ID does not exist"
Sep 18 16:39:34.757510 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.757490    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7c9ed-kube-rbac-proxy-sar-config\""
Sep 18 16:39:34.757623 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.757491    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7c9ed-serving-cert\""
Sep 18 16:39:34.757623 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.757571    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 16:39:34.757769 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.757632    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z57rx\""
Sep 18 16:39:34.761839 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.761819    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:39:34.783355 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.783299    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:39:34.786730 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.786709    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67"]
Sep 18 16:39:34.834467 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.834439    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.834594 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.834491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.935289 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.935245    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.935443 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.935308    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.935938 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.935905    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:34.937676 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:34.937659    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls\") pod \"sequence-graph-7c9ed-75c5c964bc-f49kw\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") " pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:35.066851 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.066757    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:35.333958 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.333934    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:39:35.336320 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:39:35.336293    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a09dee_28ef_43ec_80ec_169441f825ff.slice/crio-314f3df11c048eecc39a5a0f7ebc9781bbb81bec95e4c67749517e58753384a2 WatchSource:0}: Error finding container 314f3df11c048eecc39a5a0f7ebc9781bbb81bec95e4c67749517e58753384a2: Status 404 returned error can't find the container with id 314f3df11c048eecc39a5a0f7ebc9781bbb81bec95e4c67749517e58753384a2
Sep 18 16:39:35.752202 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.752169    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" event={"ID":"23a09dee-28ef-43ec-80ec-169441f825ff","Type":"ContainerStarted","Data":"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"}
Sep 18 16:39:35.752631 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.752229    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" event={"ID":"23a09dee-28ef-43ec-80ec-169441f825ff","Type":"ContainerStarted","Data":"314f3df11c048eecc39a5a0f7ebc9781bbb81bec95e4c67749517e58753384a2"}
Sep 18 16:39:35.752631 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.752259    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:35.768363 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:35.768320    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podStartSLOduration=1.76830067 podStartE2EDuration="1.76830067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:39:35.768076858 +0000 UTC m=+1432.259033291" watchObservedRunningTime="2026-09-18 16:39:35.76830067 +0000 UTC m=+1432.259257120"
Sep 18 16:39:36.000577 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:36.000543    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36fe325-e6e4-464a-876a-5eefa53603ef" path="/var/lib/kubelet/pods/d36fe325-e6e4-464a-876a-5eefa53603ef/volumes"
Sep 18 16:39:41.763759 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:41.763675    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:39:45.683082 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:45.683043    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:39:45.683573 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:45.683255    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" containerID="cri-o://a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329" gracePeriod=30
Sep 18 16:39:46.762511 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:46.762462    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:51.761643 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:51.761602    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:56.761786 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:56.761741    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:39:56.762186 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:39:56.761864    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:40:01.762082 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:01.762033    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:40:06.762196 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:06.762156    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:40:11.762232 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:11.762185    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:40:14.503121 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.503081    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:40:14.506247 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.506225    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:14.508944 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.508922    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-de495-serving-cert\""
Sep 18 16:40:14.509162 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.509147    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-de495-kube-rbac-proxy-sar-config\""
Sep 18 16:40:14.514613 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.514586    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:40:14.535133 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.535105    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:14.535228 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.535206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:14.636358 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.636325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:14.636524 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.636391    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:14.636524 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:40:14.636476    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-de495-serving-cert: secret "ensemble-graph-de495-serving-cert" not found
Sep 18 16:40:14.636636 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:40:14.636539    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls podName:a1daf0a2-283d-4ee3-8687-5611c87d2083 nodeName:}" failed. No retries permitted until 2026-09-18 16:40:15.136523238 +0000 UTC m=+1471.627479666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls") pod "ensemble-graph-de495-69977d94b8-6jnmn" (UID: "a1daf0a2-283d-4ee3-8687-5611c87d2083") : secret "ensemble-graph-de495-serving-cert" not found
Sep 18 16:40:14.636957 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:14.636938    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:15.140226 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.140190    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:15.142541 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.142518    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") pod \"ensemble-graph-de495-69977d94b8-6jnmn\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") " pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:15.418116 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.418037    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:15.686410 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.686385    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:40:15.688205 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:40:15.688170    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1daf0a2_283d_4ee3_8687_5611c87d2083.slice/crio-b1ceb0e450a1b45d53d614adbb4cd8fddc47b931ec5831093c06557a893146d1 WatchSource:0}: Error finding container b1ceb0e450a1b45d53d614adbb4cd8fddc47b931ec5831093c06557a893146d1: Status 404 returned error can't find the container with id b1ceb0e450a1b45d53d614adbb4cd8fddc47b931ec5831093c06557a893146d1
Sep 18 16:40:15.868548 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.868522    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:40:15.926341 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.926302    2552 generic.go:356] "Generic (PLEG): container finished" podID="23a09dee-28ef-43ec-80ec-169441f825ff" containerID="a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329" exitCode=137
Sep 18 16:40:15.926341 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.926344    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"
Sep 18 16:40:15.926557 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.926390    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" event={"ID":"23a09dee-28ef-43ec-80ec-169441f825ff","Type":"ContainerDied","Data":"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"}
Sep 18 16:40:15.926557 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.926446    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw" event={"ID":"23a09dee-28ef-43ec-80ec-169441f825ff","Type":"ContainerDied","Data":"314f3df11c048eecc39a5a0f7ebc9781bbb81bec95e4c67749517e58753384a2"}
Sep 18 16:40:15.926557 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.926471    2552 scope.go:117] "RemoveContainer" containerID="a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"
Sep 18 16:40:15.927957 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.927932    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" event={"ID":"a1daf0a2-283d-4ee3-8687-5611c87d2083","Type":"ContainerStarted","Data":"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"}
Sep 18 16:40:15.928086 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.928000    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" event={"ID":"a1daf0a2-283d-4ee3-8687-5611c87d2083","Type":"ContainerStarted","Data":"b1ceb0e450a1b45d53d614adbb4cd8fddc47b931ec5831093c06557a893146d1"}
Sep 18 16:40:15.928086 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.928023    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:15.934259 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.934242    2552 scope.go:117] "RemoveContainer" containerID="a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"
Sep 18 16:40:15.934524 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:40:15.934504    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329\": container with ID starting with a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329 not found: ID does not exist" containerID="a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"
Sep 18 16:40:15.934567 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.934532    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329"} err="failed to get container status \"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329\": rpc error: code = NotFound desc = could not find container \"a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329\": container with ID starting with a50e0f9b9f29d7ff652132163b64d16b693abfb4a977ed4882f60b6efccb3329 not found: ID does not exist"
Sep 18 16:40:15.947253 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:15.947179    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podStartSLOduration=1.947164163 podStartE2EDuration="1.947164163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:40:15.946041197 +0000 UTC m=+1472.436997650" watchObservedRunningTime="2026-09-18 16:40:15.947164163 +0000 UTC m=+1472.438120613"
Sep 18 16:40:16.045640 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.045606    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls\") pod \"23a09dee-28ef-43ec-80ec-169441f825ff\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") "
Sep 18 16:40:16.045802 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.045657    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle\") pod \"23a09dee-28ef-43ec-80ec-169441f825ff\" (UID: \"23a09dee-28ef-43ec-80ec-169441f825ff\") "
Sep 18 16:40:16.046048 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.046019    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "23a09dee-28ef-43ec-80ec-169441f825ff" (UID: "23a09dee-28ef-43ec-80ec-169441f825ff"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:40:16.047636 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.047617    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "23a09dee-28ef-43ec-80ec-169441f825ff" (UID: "23a09dee-28ef-43ec-80ec-169441f825ff"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:40:16.146674 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.146643    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a09dee-28ef-43ec-80ec-169441f825ff-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:40:16.146674 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.146672    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23a09dee-28ef-43ec-80ec-169441f825ff-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:40:16.247518 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.247487    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:40:16.249063 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:16.249043    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw"]
Sep 18 16:40:17.999865 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:17.999828    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" path="/var/lib/kubelet/pods/23a09dee-28ef-43ec-80ec-169441f825ff/volumes"
Sep 18 16:40:21.938960 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:21.938927    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:40:43.968796 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:43.968764    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:40:43.971414 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:43.971388    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:40:55.944061 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.943970    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:40:55.944585 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.944403    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed"
Sep 18 16:40:55.944585 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.944424    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed"
Sep 18 16:40:55.944585 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.944527    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a09dee-28ef-43ec-80ec-169441f825ff" containerName="sequence-graph-7c9ed"
Sep 18 16:40:55.947569 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.947546    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:55.950250 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.950218    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-630d7-kube-rbac-proxy-sar-config\""
Sep 18 16:40:55.950250 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.950243    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-630d7-serving-cert\""
Sep 18 16:40:55.955922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:55.955899    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:40:56.033258 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.033222    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.033455 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.033266    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.134326 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.134285    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.134529 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.134352    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.134529 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:40:56.134448    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-630d7-serving-cert: secret "sequence-graph-630d7-serving-cert" not found
Sep 18 16:40:56.134529 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:40:56.134518    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls podName:eedb7ec0-db5e-44fc-a93f-7ccce6e43261 nodeName:}" failed. No retries permitted until 2026-09-18 16:40:56.634501932 +0000 UTC m=+1513.125458360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls") pod "sequence-graph-630d7-56cf9d7d54-gs9ts" (UID: "eedb7ec0-db5e-44fc-a93f-7ccce6e43261") : secret "sequence-graph-630d7-serving-cert" not found
Sep 18 16:40:56.134945 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.134925    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.637792 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.637747    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.640190 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.640157    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") pod \"sequence-graph-630d7-56cf9d7d54-gs9ts\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") " pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:56.858492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:56.858441    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:57.131159 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:57.131130    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:40:57.133692 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:40:57.133665    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedb7ec0_db5e_44fc_a93f_7ccce6e43261.slice/crio-6f08d4b2fa20e9a995112cda8fb50de9d5f72d11477b9d256d4058f8763e39f1 WatchSource:0}: Error finding container 6f08d4b2fa20e9a995112cda8fb50de9d5f72d11477b9d256d4058f8763e39f1: Status 404 returned error can't find the container with id 6f08d4b2fa20e9a995112cda8fb50de9d5f72d11477b9d256d4058f8763e39f1
Sep 18 16:40:58.095749 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:58.095698    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" event={"ID":"eedb7ec0-db5e-44fc-a93f-7ccce6e43261","Type":"ContainerStarted","Data":"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"}
Sep 18 16:40:58.095922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:58.095762    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" event={"ID":"eedb7ec0-db5e-44fc-a93f-7ccce6e43261","Type":"ContainerStarted","Data":"6f08d4b2fa20e9a995112cda8fb50de9d5f72d11477b9d256d4058f8763e39f1"}
Sep 18 16:40:58.095922 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:58.095808    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:40:58.113034 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:40:58.112972    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podStartSLOduration=3.112957001 podStartE2EDuration="3.112957001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:40:58.111396793 +0000 UTC m=+1514.602353245" watchObservedRunningTime="2026-09-18 16:40:58.112957001 +0000 UTC m=+1514.603913493"
Sep 18 16:41:04.105107 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:41:04.105078    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:45:43.994625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:45:43.994592    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:45:43.995954 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:45:43.995934    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:48:29.503437 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:29.503368    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:48:29.503928 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:29.503655    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" containerID="cri-o://b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2" gracePeriod=30
Sep 18 16:48:31.937656 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:31.937610    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:36.937625 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:36.937536    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:41.936858 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:41.936813    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:41.937287 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:41.936937    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:48:46.939399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:46.939357    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:51.937537 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:51.937494    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:56.937928 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:56.937887    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:48:59.654821 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.654793    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:48:59.762087 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.761999    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") pod \"a1daf0a2-283d-4ee3-8687-5611c87d2083\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") "
Sep 18 16:48:59.762087 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.762071    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle\") pod \"a1daf0a2-283d-4ee3-8687-5611c87d2083\" (UID: \"a1daf0a2-283d-4ee3-8687-5611c87d2083\") "
Sep 18 16:48:59.762431 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.762406    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a1daf0a2-283d-4ee3-8687-5611c87d2083" (UID: "a1daf0a2-283d-4ee3-8687-5611c87d2083"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:48:59.764081 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.764049    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a1daf0a2-283d-4ee3-8687-5611c87d2083" (UID: "a1daf0a2-283d-4ee3-8687-5611c87d2083"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:48:59.863571 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.863535    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1daf0a2-283d-4ee3-8687-5611c87d2083-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:48:59.863571 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:48:59.863565    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1daf0a2-283d-4ee3-8687-5611c87d2083-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:49:00.040313 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.040221    2552 generic.go:356] "Generic (PLEG): container finished" podID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerID="b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2" exitCode=0
Sep 18 16:49:00.040313 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.040265    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"
Sep 18 16:49:00.040494 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.040305    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" event={"ID":"a1daf0a2-283d-4ee3-8687-5611c87d2083","Type":"ContainerDied","Data":"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"}
Sep 18 16:49:00.040494 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.040358    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn" event={"ID":"a1daf0a2-283d-4ee3-8687-5611c87d2083","Type":"ContainerDied","Data":"b1ceb0e450a1b45d53d614adbb4cd8fddc47b931ec5831093c06557a893146d1"}
Sep 18 16:49:00.040494 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.040381    2552 scope.go:117] "RemoveContainer" containerID="b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"
Sep 18 16:49:00.048473 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.048453    2552 scope.go:117] "RemoveContainer" containerID="b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"
Sep 18 16:49:00.048755 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:49:00.048738    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2\": container with ID starting with b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2 not found: ID does not exist" containerID="b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"
Sep 18 16:49:00.048799 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.048764    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2"} err="failed to get container status \"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2\": rpc error: code = NotFound desc = could not find container \"b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2\": container with ID starting with b08b5461bcc8b159aed646c87bd67f424eadcba5b8f1729920af43d95fcf6cd2 not found: ID does not exist"
Sep 18 16:49:00.057304 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.057279    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:49:00.062101 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:00.062079    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn"]
Sep 18 16:49:01.999481 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:01.999444    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" path="/var/lib/kubelet/pods/a1daf0a2-283d-4ee3-8687-5611c87d2083/volumes"
Sep 18 16:49:10.794817 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:10.794778    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:49:10.795270 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:10.794970    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" containerID="cri-o://2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3" gracePeriod=30
Sep 18 16:49:14.104323 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:14.104275    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:19.103842 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:19.103794    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:24.104568 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:24.104521    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:24.105139 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:24.104627    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:49:29.104660 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:29.104623    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:34.103680 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:34.103629    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:39.103815 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.103768    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:39.750417 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.750345    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:49:39.750651 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.750637    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495"
Sep 18 16:49:39.750695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.750652    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495"
Sep 18 16:49:39.750736 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.750727    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1daf0a2-283d-4ee3-8687-5611c87d2083" containerName="ensemble-graph-de495"
Sep 18 16:49:39.753296 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.753279    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.758381 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.758355    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b3de6-kube-rbac-proxy-sar-config\""
Sep 18 16:49:39.758495 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.758355    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b3de6-serving-cert\""
Sep 18 16:49:39.767168 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.767146    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:49:39.878107 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.878076    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.878240 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.878129    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.979301 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.979264    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.979439 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.979316    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.979876 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.979856    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:39.981797 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:39.981776    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls\") pod \"splitter-graph-b3de6-586d65fc7b-lczd2\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") " pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:40.063393 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:40.063337    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:40.332164 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:40.332125    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:49:40.334398 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:49:40.334370    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5b78e9_4e2e_4518_90bb_5fe642eda8ff.slice/crio-14624c8d34158ca69fef919b8ad9fe680fa282b700ce5f18f17639745e7bdfcd WatchSource:0}: Error finding container 14624c8d34158ca69fef919b8ad9fe680fa282b700ce5f18f17639745e7bdfcd: Status 404 returned error can't find the container with id 14624c8d34158ca69fef919b8ad9fe680fa282b700ce5f18f17639745e7bdfcd
Sep 18 16:49:40.932944 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:40.932914    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:49:41.087832 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.087750    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") pod \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") "
Sep 18 16:49:41.087832 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.087810    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle\") pod \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\" (UID: \"eedb7ec0-db5e-44fc-a93f-7ccce6e43261\") "
Sep 18 16:49:41.088194 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.088170    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "eedb7ec0-db5e-44fc-a93f-7ccce6e43261" (UID: "eedb7ec0-db5e-44fc-a93f-7ccce6e43261"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:49:41.089713 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.089687    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "eedb7ec0-db5e-44fc-a93f-7ccce6e43261" (UID: "eedb7ec0-db5e-44fc-a93f-7ccce6e43261"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:49:41.188694 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.188667    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:49:41.188694 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.188693    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb7ec0-db5e-44fc-a93f-7ccce6e43261-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:49:41.210416 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.210383    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" event={"ID":"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff","Type":"ContainerStarted","Data":"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"}
Sep 18 16:49:41.210553 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.210440    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:41.210553 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.210464    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" event={"ID":"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff","Type":"ContainerStarted","Data":"14624c8d34158ca69fef919b8ad9fe680fa282b700ce5f18f17639745e7bdfcd"}
Sep 18 16:49:41.211611 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.211588    2552 generic.go:356] "Generic (PLEG): container finished" podID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerID="2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3" exitCode=0
Sep 18 16:49:41.211695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.211620    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"
Sep 18 16:49:41.211695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.211641    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" event={"ID":"eedb7ec0-db5e-44fc-a93f-7ccce6e43261","Type":"ContainerDied","Data":"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"}
Sep 18 16:49:41.211695 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.211678    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts" event={"ID":"eedb7ec0-db5e-44fc-a93f-7ccce6e43261","Type":"ContainerDied","Data":"6f08d4b2fa20e9a995112cda8fb50de9d5f72d11477b9d256d4058f8763e39f1"}
Sep 18 16:49:41.211802 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.211702    2552 scope.go:117] "RemoveContainer" containerID="2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"
Sep 18 16:49:41.219399 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.219361    2552 scope.go:117] "RemoveContainer" containerID="2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"
Sep 18 16:49:41.219633 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:49:41.219610    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3\": container with ID starting with 2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3 not found: ID does not exist" containerID="2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"
Sep 18 16:49:41.219717 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.219638    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3"} err="failed to get container status \"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3\": rpc error: code = NotFound desc = could not find container \"2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3\": container with ID starting with 2560b2fb6f6dd3669b92adefd44a9378dcdff6453a8154ada53d6ca5c0958de3 not found: ID does not exist"
Sep 18 16:49:41.228645 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.228606    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podStartSLOduration=2.228593389 podStartE2EDuration="2.228593389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:41.227396787 +0000 UTC m=+2037.718353248" watchObservedRunningTime="2026-09-18 16:49:41.228593389 +0000 UTC m=+2037.719549840"
Sep 18 16:49:41.244208 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.244183    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:49:41.248157 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:41.248138    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts"]
Sep 18 16:49:42.000298 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:42.000265    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" path="/var/lib/kubelet/pods/eedb7ec0-db5e-44fc-a93f-7ccce6e43261/volumes"
Sep 18 16:49:47.226666 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:47.226635    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:49:50.788034 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:50.787996    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:49:50.788398 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:50.788224    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" containerID="cri-o://6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7" gracePeriod=30
Sep 18 16:49:52.225700 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:52.225662    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:49:57.224895 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:49:57.224849    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:02.225778 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:02.225735    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:02.226168 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:02.225865    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:50:07.225513 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:07.225424    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:12.225609 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:12.225562    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:17.224844 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:17.224796    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:50:20.951411 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:20.951389    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:50:20.976316 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:20.976287    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle\") pod \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") "
Sep 18 16:50:20.976449 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:20.976340    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls\") pod \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\" (UID: \"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff\") "
Sep 18 16:50:20.976622 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:20.976597    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" (UID: "5b5b78e9-4e2e-4518-90bb-5fe642eda8ff"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:50:20.978244 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:20.978221    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" (UID: "5b5b78e9-4e2e-4518-90bb-5fe642eda8ff"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:50:21.044309 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044236    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 16:50:21.044606 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044576    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6"
Sep 18 16:50:21.044606 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044598    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6"
Sep 18 16:50:21.044738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044616    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7"
Sep 18 16:50:21.044738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044625    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7"
Sep 18 16:50:21.044738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044712    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerName="splitter-graph-b3de6"
Sep 18 16:50:21.044738 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.044724    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eedb7ec0-db5e-44fc-a93f-7ccce6e43261" containerName="sequence-graph-630d7"
Sep 18 16:50:21.047539 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.047517    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.049947 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.049926    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a2696-serving-cert\""
Sep 18 16:50:21.050104 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.050080    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a2696-kube-rbac-proxy-sar-config\""
Sep 18 16:50:21.055957 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.055934    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 16:50:21.076950 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.076928    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.077073 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.076960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.077120 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.077104    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:50:21.077165 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.077129    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:50:21.177761 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.177735    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.177886 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.177767    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.177929 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:50:21.177888    2552 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-a2696-serving-cert: secret "switch-graph-a2696-serving-cert" not found
Sep 18 16:50:21.177993 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:50:21.177969    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls podName:cab18aeb-ddda-490a-95cc-509bb9e21939 nodeName:}" failed. No retries permitted until 2026-09-18 16:50:21.6779498 +0000 UTC m=+2078.168906235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls") pod "switch-graph-a2696-7758d57596-5hcnh" (UID: "cab18aeb-ddda-490a-95cc-509bb9e21939") : secret "switch-graph-a2696-serving-cert" not found
Sep 18 16:50:21.178329 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.178312    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.377952 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.377852    2552 generic.go:356] "Generic (PLEG): container finished" podID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" containerID="6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7" exitCode=137
Sep 18 16:50:21.377952 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.377898    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"
Sep 18 16:50:21.377952 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.377905    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" event={"ID":"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff","Type":"ContainerDied","Data":"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"}
Sep 18 16:50:21.378266 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.378019    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2" event={"ID":"5b5b78e9-4e2e-4518-90bb-5fe642eda8ff","Type":"ContainerDied","Data":"14624c8d34158ca69fef919b8ad9fe680fa282b700ce5f18f17639745e7bdfcd"}
Sep 18 16:50:21.378266 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.378051    2552 scope.go:117] "RemoveContainer" containerID="6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"
Sep 18 16:50:21.390424 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.390404    2552 scope.go:117] "RemoveContainer" containerID="6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"
Sep 18 16:50:21.390694 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:50:21.390674    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7\": container with ID starting with 6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7 not found: ID does not exist" containerID="6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"
Sep 18 16:50:21.390759 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.390701    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7"} err="failed to get container status \"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7\": rpc error: code = NotFound desc = could not find container \"6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7\": container with ID starting with 6635c37f5f95b3ae1d9557ea8d171bc01a114cba24c81e3fce3f15b22928d6a7 not found: ID does not exist"
Sep 18 16:50:21.403153 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.403133    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:50:21.407107 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.407087    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2"]
Sep 18 16:50:21.680691 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.680593    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.683066 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.683039    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") pod \"switch-graph-a2696-7758d57596-5hcnh\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") " pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.958164 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.958067    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:21.999998 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:21.999947    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b5b78e9-4e2e-4518-90bb-5fe642eda8ff" path="/var/lib/kubelet/pods/5b5b78e9-4e2e-4518-90bb-5fe642eda8ff/volumes"
Sep 18 16:50:22.230286 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:22.230255    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 16:50:22.233178 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:50:22.233148    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab18aeb_ddda_490a_95cc_509bb9e21939.slice/crio-b364d6cd7eb3a5080437f94f785f1c6c77ce3e293ce89b4ae66e5b88f7d3b79c WatchSource:0}: Error finding container b364d6cd7eb3a5080437f94f785f1c6c77ce3e293ce89b4ae66e5b88f7d3b79c: Status 404 returned error can't find the container with id b364d6cd7eb3a5080437f94f785f1c6c77ce3e293ce89b4ae66e5b88f7d3b79c
Sep 18 16:50:22.383293 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:22.383251    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" event={"ID":"cab18aeb-ddda-490a-95cc-509bb9e21939","Type":"ContainerStarted","Data":"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"}
Sep 18 16:50:22.383472 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:22.383392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:22.383472 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:22.383419    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" event={"ID":"cab18aeb-ddda-490a-95cc-509bb9e21939","Type":"ContainerStarted","Data":"b364d6cd7eb3a5080437f94f785f1c6c77ce3e293ce89b4ae66e5b88f7d3b79c"}
Sep 18 16:50:22.400999 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:22.400931    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podStartSLOduration=1.400917648 podStartE2EDuration="1.400917648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:50:22.399548669 +0000 UTC m=+2078.890505119" watchObservedRunningTime="2026-09-18 16:50:22.400917648 +0000 UTC m=+2078.891874098"
Sep 18 16:50:28.394664 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:28.394635    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 16:50:44.020174 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:44.020141    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:50:44.022583 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:50:44.022560    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:51:01.026894 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.026862    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:51:01.030129 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.030110    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.032920 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.032897    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-bb388-kube-rbac-proxy-sar-config\""
Sep 18 16:51:01.033076 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.033056    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-bb388-serving-cert\""
Sep 18 16:51:01.039736 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.039710    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:51:01.176306 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.176277    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.176462 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.176322    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.277395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.277291    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.277395 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.277357    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.277937 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.277913    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.279762 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.279739    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls\") pod \"splitter-graph-bb388-5b7597b4b8-nsmq4\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") " pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.341050 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.341003    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:01.610298 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:01.610275    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:51:01.612370 ip-10-0-128-224 kubenswrapper[2552]: W0918 16:51:01.612344    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a8d449_a3ee_4f1b_bd42_810e612dc445.slice/crio-419fde12c9352f8824873345a5134d1359d929b7dadcdc16cfa04d023ea68981 WatchSource:0}: Error finding container 419fde12c9352f8824873345a5134d1359d929b7dadcdc16cfa04d023ea68981: Status 404 returned error can't find the container with id 419fde12c9352f8824873345a5134d1359d929b7dadcdc16cfa04d023ea68981
Sep 18 16:51:02.540642 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:02.540607    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" event={"ID":"31a8d449-a3ee-4f1b-bd42-810e612dc445","Type":"ContainerStarted","Data":"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"}
Sep 18 16:51:02.541044 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:02.540661    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" event={"ID":"31a8d449-a3ee-4f1b-bd42-810e612dc445","Type":"ContainerStarted","Data":"419fde12c9352f8824873345a5134d1359d929b7dadcdc16cfa04d023ea68981"}
Sep 18 16:51:02.541044 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:02.540726    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:51:02.559597 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:02.559550    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podStartSLOduration=1.559536646 podStartE2EDuration="1.559536646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:51:02.557702377 +0000 UTC m=+2119.048658827" watchObservedRunningTime="2026-09-18 16:51:02.559536646 +0000 UTC m=+2119.050493097"
Sep 18 16:51:08.550271 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:51:08.550236    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:55:44.042993 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:55:44.042950    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:55:44.046357 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:55:44.046334    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 16:59:16.071942 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:16.071906    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:59:16.072488 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:16.072175    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" containerID="cri-o://e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6" gracePeriod=30
Sep 18 16:59:18.549311 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:18.549269    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:23.549641 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:23.549596    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:28.549563 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:28.549516    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:28.549987 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:28.549626    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:59:33.548970 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:33.548916    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:38.548961 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:38.548917    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:43.549652 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:43.549600    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 16:59:46.212544 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.212513    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:59:46.352344 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.352251    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle\") pod \"31a8d449-a3ee-4f1b-bd42-810e612dc445\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") "
Sep 18 16:59:46.352344 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.352301    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls\") pod \"31a8d449-a3ee-4f1b-bd42-810e612dc445\" (UID: \"31a8d449-a3ee-4f1b-bd42-810e612dc445\") "
Sep 18 16:59:46.352629 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.352604    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "31a8d449-a3ee-4f1b-bd42-810e612dc445" (UID: "31a8d449-a3ee-4f1b-bd42-810e612dc445"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 16:59:46.354374 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.354351    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "31a8d449-a3ee-4f1b-bd42-810e612dc445" (UID: "31a8d449-a3ee-4f1b-bd42-810e612dc445"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 16:59:46.453135 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.453096    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/31a8d449-a3ee-4f1b-bd42-810e612dc445-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:59:46.453135 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.453131    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31a8d449-a3ee-4f1b-bd42-810e612dc445-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 16:59:46.643083 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.642999    2552 generic.go:356] "Generic (PLEG): container finished" podID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerID="e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6" exitCode=137
Sep 18 16:59:46.643083 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.643039    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"
Sep 18 16:59:46.643083 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.643060    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" event={"ID":"31a8d449-a3ee-4f1b-bd42-810e612dc445","Type":"ContainerDied","Data":"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"}
Sep 18 16:59:46.643291 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.643117    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4" event={"ID":"31a8d449-a3ee-4f1b-bd42-810e612dc445","Type":"ContainerDied","Data":"419fde12c9352f8824873345a5134d1359d929b7dadcdc16cfa04d023ea68981"}
Sep 18 16:59:46.643291 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.643140    2552 scope.go:117] "RemoveContainer" containerID="e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"
Sep 18 16:59:46.651670 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.651648    2552 scope.go:117] "RemoveContainer" containerID="e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"
Sep 18 16:59:46.651962 ip-10-0-128-224 kubenswrapper[2552]: E0918 16:59:46.651937    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6\": container with ID starting with e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6 not found: ID does not exist" containerID="e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"
Sep 18 16:59:46.652063 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.651970    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6"} err="failed to get container status \"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6\": rpc error: code = NotFound desc = could not find container \"e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6\": container with ID starting with e3477e54950b22d253814db0c6a6cd1b17572b09fd05f29b2bb706bf51a105a6 not found: ID does not exist"
Sep 18 16:59:46.665113 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.665078    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:59:46.670351 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:46.670325    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4"]
Sep 18 16:59:48.000492 ip-10-0-128-224 kubenswrapper[2552]: I0918 16:59:48.000453    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" path="/var/lib/kubelet/pods/31a8d449-a3ee-4f1b-bd42-810e612dc445/volumes"
Sep 18 17:00:44.065385 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:00:44.065275    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 17:00:44.069814 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:00:44.069794    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 17:05:44.087645 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:05:44.087523    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 17:05:44.093377 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:05:44.093355    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 17:06:41.115687 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:41.115599    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 17:06:41.116214 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:41.115845    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" containerID="cri-o://58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b" gracePeriod=30
Sep 18 17:06:43.393265 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:43.393219    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:06:48.392989 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:48.392941    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:06:53.393475 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:53.393437    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:06:53.393849 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:53.393557    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 17:06:57.756276 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:57.756241    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:06:58.392909 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:58.392863    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:06:58.585987 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:58.585941    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:06:59.410619 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:06:59.410587    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:00.195430 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:00.195401    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:00.969141 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:00.969111    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:01.744544 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:01.744514    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:02.532476 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:02.532435    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:03.316655 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:03.316628    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:03.393295 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:03.393254    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:07:04.103225 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:04.103191    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:04.923757 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:04.923720    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:05.699778 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:05.699746    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:06.492217 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:06.492187    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:07.310073 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:07.310045    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:08.124615 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:08.124582    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:08.393545 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:08.393458    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:07:08.959812 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:08.959783    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a2696-7758d57596-5hcnh_cab18aeb-ddda-490a-95cc-509bb9e21939/switch-graph-a2696/0.log"
Sep 18 17:07:11.264759 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.264735    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 17:07:11.362173 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.362136    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") pod \"cab18aeb-ddda-490a-95cc-509bb9e21939\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") "
Sep 18 17:07:11.362173 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.362173    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle\") pod \"cab18aeb-ddda-490a-95cc-509bb9e21939\" (UID: \"cab18aeb-ddda-490a-95cc-509bb9e21939\") "
Sep 18 17:07:11.362559 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.362535    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "cab18aeb-ddda-490a-95cc-509bb9e21939" (UID: "cab18aeb-ddda-490a-95cc-509bb9e21939"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:07:11.364175 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.364157    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cab18aeb-ddda-490a-95cc-509bb9e21939" (UID: "cab18aeb-ddda-490a-95cc-509bb9e21939"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:07:11.418143 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.418059    2552 generic.go:356] "Generic (PLEG): container finished" podID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerID="58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b" exitCode=0
Sep 18 17:07:11.418143 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.418107    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"
Sep 18 17:07:11.418359 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.418155    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" event={"ID":"cab18aeb-ddda-490a-95cc-509bb9e21939","Type":"ContainerDied","Data":"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"}
Sep 18 17:07:11.418359 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.418213    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh" event={"ID":"cab18aeb-ddda-490a-95cc-509bb9e21939","Type":"ContainerDied","Data":"b364d6cd7eb3a5080437f94f785f1c6c77ce3e293ce89b4ae66e5b88f7d3b79c"}
Sep 18 17:07:11.418359 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.418246    2552 scope.go:117] "RemoveContainer" containerID="58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"
Sep 18 17:07:11.426589 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.426569    2552 scope.go:117] "RemoveContainer" containerID="58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"
Sep 18 17:07:11.426871 ip-10-0-128-224 kubenswrapper[2552]: E0918 17:07:11.426850    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b\": container with ID starting with 58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b not found: ID does not exist" containerID="58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"
Sep 18 17:07:11.426934 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.426879    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b"} err="failed to get container status \"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b\": rpc error: code = NotFound desc = could not find container \"58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b\": container with ID starting with 58b6d8bf43318e97baed20dcc7bad97c8da2d6b66d6d5ddbc8bf79a56a1d857b not found: ID does not exist"
Sep 18 17:07:11.439832 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.439809    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 17:07:11.446477 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.446455    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh"]
Sep 18 17:07:11.463028 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.463010    2552 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cab18aeb-ddda-490a-95cc-509bb9e21939-proxy-tls\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 17:07:11.463099 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:11.463030    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cab18aeb-ddda-490a-95cc-509bb9e21939-openshift-service-ca-bundle\") on node \"ip-10-0-128-224.ec2.internal\" DevicePath \"\""
Sep 18 17:07:12.004352 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:12.004316    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" path="/var/lib/kubelet/pods/cab18aeb-ddda-490a-95cc-509bb9e21939/volumes"
Sep 18 17:07:15.292844 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:15.292812    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dqnn7_7a497cea-5563-452c-a622-16becb8a0134/global-pull-secret-syncer/0.log"
Sep 18 17:07:15.464624 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:15.464585    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s7rn9_cd11577e-bdc6-4c35-bb44-fdb1b05b63e9/konnectivity-agent/0.log"
Sep 18 17:07:15.568745 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:15.568665    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-224.ec2.internal_64e53398dbf928ecaca3a4fe5d4a5d05/haproxy/0.log"
Sep 18 17:07:19.731439 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:19.731408    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxdbs_9d592c58-a5fb-43e5-ad36-4877d7b5abd9/node-exporter/0.log"
Sep 18 17:07:19.765154 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:19.765126    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxdbs_9d592c58-a5fb-43e5-ad36-4877d7b5abd9/kube-rbac-proxy/0.log"
Sep 18 17:07:19.791751 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:19.791728    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxdbs_9d592c58-a5fb-43e5-ad36-4877d7b5abd9/init-textfile/0.log"
Sep 18 17:07:20.322912 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:20.322884    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-pv65z_9cea2de1-c3af-4368-aa5e-b4b111d7c24d/prometheus-operator-admission-webhook/0.log"
Sep 18 17:07:22.967713 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:22.967682    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-flsxv_005bc971-21b7-4a84-a82a-20ddb07500ff/download-server/0.log"
Sep 18 17:07:23.918124 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918090    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"]
Sep 18 17:07:23.918371 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918359    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696"
Sep 18 17:07:23.918426 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918373    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696"
Sep 18 17:07:23.918426 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918389    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388"
Sep 18 17:07:23.918426 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918395    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388"
Sep 18 17:07:23.918529 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918447    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab18aeb-ddda-490a-95cc-509bb9e21939" containerName="switch-graph-a2696"
Sep 18 17:07:23.918529 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.918455    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a8d449-a3ee-4f1b-bd42-810e612dc445" containerName="splitter-graph-bb388"
Sep 18 17:07:23.922853 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.922831    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:23.926521 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.926493    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpw2m\"/\"openshift-service-ca.crt\""
Sep 18 17:07:23.926521 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.926519    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zpw2m\"/\"default-dockercfg-2hq6t\""
Sep 18 17:07:23.927707 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.927686    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpw2m\"/\"kube-root-ca.crt\""
Sep 18 17:07:23.933193 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.933167    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"]
Sep 18 17:07:23.954199 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.954158    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpcl\" (UniqueName: \"kubernetes.io/projected/0ab769b6-ba83-4742-8a06-4ecc140e1828-kube-api-access-jzpcl\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:23.954199 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.954204    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-proc\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:23.954407 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.954222    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-podres\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:23.954407 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.954270    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-lib-modules\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:23.954407 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:23.954320    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-sys\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.054819 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.054777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-lib-modules\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.054851    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-sys\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055010    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-lib-modules\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055046    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-sys\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055191    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpcl\" (UniqueName: \"kubernetes.io/projected/0ab769b6-ba83-4742-8a06-4ecc140e1828-kube-api-access-jzpcl\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055280    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-proc\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055353 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055312    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-podres\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055597 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055383    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-proc\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.055597 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.055440    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ab769b6-ba83-4742-8a06-4ecc140e1828-podres\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.064635 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.064605    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpcl\" (UniqueName: \"kubernetes.io/projected/0ab769b6-ba83-4742-8a06-4ecc140e1828-kube-api-access-jzpcl\") pod \"perf-node-gather-daemonset-zvqpm\" (UID: \"0ab769b6-ba83-4742-8a06-4ecc140e1828\") " pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.233064 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.233023    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:24.502513 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.501621    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"]
Sep 18 17:07:24.508146 ip-10-0-128-224 kubenswrapper[2552]: W0918 17:07:24.508106    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ab769b6_ba83_4742_8a06_4ecc140e1828.slice/crio-800691b3738b02e108f70274e48aed3d2ec08127f060010ab5db389e2868fe19 WatchSource:0}: Error finding container 800691b3738b02e108f70274e48aed3d2ec08127f060010ab5db389e2868fe19: Status 404 returned error can't find the container with id 800691b3738b02e108f70274e48aed3d2ec08127f060010ab5db389e2868fe19
Sep 18 17:07:24.530866 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.530846    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq425_0a0376ee-b526-4b8e-b7c0-0ad0b6c49029/dns/0.log"
Sep 18 17:07:24.554686 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.554659    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq425_0a0376ee-b526-4b8e-b7c0-0ad0b6c49029/kube-rbac-proxy/0.log"
Sep 18 17:07:24.647360 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:24.647333    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2pp9_953c47d7-17b9-4d8f-8cf5-eabab7a756b8/dns-node-resolver/0.log"
Sep 18 17:07:25.127455 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.127424    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dd9d5f6f7-tmgb4_a5bb1e00-9b6a-47dc-a804-4be1fcf3de36/registry/0.log"
Sep 18 17:07:25.200174 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.200113    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqgrq_d0c50fd8-df66-4e5e-9c48-7439edc9682f/node-ca/0.log"
Sep 18 17:07:25.477711 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.477679    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm" event={"ID":"0ab769b6-ba83-4742-8a06-4ecc140e1828","Type":"ContainerStarted","Data":"db0aeca60913139f2061a9812a708168cbffe5fc2169910bb06ec19e5cb1b6b7"}
Sep 18 17:07:25.477889 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.477729    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm" event={"ID":"0ab769b6-ba83-4742-8a06-4ecc140e1828","Type":"ContainerStarted","Data":"800691b3738b02e108f70274e48aed3d2ec08127f060010ab5db389e2868fe19"}
Sep 18 17:07:25.477889 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.477802    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:25.494938 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:25.494894    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm" podStartSLOduration=2.494880281 podStartE2EDuration="2.494880281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:07:25.494153866 +0000 UTC m=+3101.985110317" watchObservedRunningTime="2026-09-18 17:07:25.494880281 +0000 UTC m=+3101.985836732"
Sep 18 17:07:26.363676 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:26.363649    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvt2x_830cc37b-b3f1-4537-81ac-76d8f6abbf19/serve-healthcheck-canary/0.log"
Sep 18 17:07:26.917800 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:26.917765    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6t97_f5b6fc67-bbdc-4686-bdaf-1ba49a762fea/kube-rbac-proxy/0.log"
Sep 18 17:07:26.937368 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:26.937337    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6t97_f5b6fc67-bbdc-4686-bdaf-1ba49a762fea/exporter/0.log"
Sep 18 17:07:26.959825 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:26.959795    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n6t97_f5b6fc67-bbdc-4686-bdaf-1ba49a762fea/extractor/0.log"
Sep 18 17:07:29.189882 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:29.189850    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7dcf4bff6-6btnt_5e48e3cb-8c24-477f-bd54-56f111dd0394/manager/0.log"
Sep 18 17:07:29.245694 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:29.245668    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-wbnmr_c05a3a35-70e5-4bfd-84ad-4342b27b47c9/server/0.log"
Sep 18 17:07:29.422219 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:29.422193    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-bnhrg_0fc1f07a-9ed7-40c1-a479-6dc5f8e431e1/seaweedfs/0.log"
Sep 18 17:07:31.491644 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:31.491611    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zpw2m/perf-node-gather-daemonset-zvqpm"
Sep 18 17:07:33.452858 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:33.452823    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fdmg8_280a0bb0-8236-4bd4-a355-78a62e69e05f/migrator/0.log"
Sep 18 17:07:33.480023 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:33.479999    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fdmg8_280a0bb0-8236-4bd4-a355-78a62e69e05f/graceful-termination/0.log"
Sep 18 17:07:34.803430 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:34.803399    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6bhgj_7d77dd56-a175-4a39-8314-155bb5e40fa6/kube-multus/0.log"
Sep 18 17:07:35.028557 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.028532    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/kube-multus-additional-cni-plugins/0.log"
Sep 18 17:07:35.049099 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.049076    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/egress-router-binary-copy/0.log"
Sep 18 17:07:35.068906 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.068885    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/cni-plugins/0.log"
Sep 18 17:07:35.088130 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.088106    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/bond-cni-plugin/0.log"
Sep 18 17:07:35.107340 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.107319    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/routeoverride-cni/0.log"
Sep 18 17:07:35.126310 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.126292    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/whereabouts-cni-bincopy/0.log"
Sep 18 17:07:35.148145 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.148115    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hc9z7_fc0c37e1-3e38-4aa5-bdc8-818eeac4fbb4/whereabouts-cni/0.log"
Sep 18 17:07:35.371192 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.371162    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9m57n_5d13926e-bdb5-457f-919a-5557417a65ad/network-metrics-daemon/0.log"
Sep 18 17:07:35.393576 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:35.393551    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9m57n_5d13926e-bdb5-457f-919a-5557417a65ad/kube-rbac-proxy/0.log"
Sep 18 17:07:36.644554 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.644513    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-controller/0.log"
Sep 18 17:07:36.666133 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.666105    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/0.log"
Sep 18 17:07:36.666314 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.666173    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovn-acl-logging/1.log"
Sep 18 17:07:36.683792 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.683769    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/kube-rbac-proxy-node/0.log"
Sep 18 17:07:36.706268 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.706218    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/kube-rbac-proxy-ovn-metrics/0.log"
Sep 18 17:07:36.732123 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.732084    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/northd/0.log"
Sep 18 17:07:36.753536 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.753503    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/nbdb/0.log"
Sep 18 17:07:36.785759 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.785735    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/sbdb/0.log"
Sep 18 17:07:36.827103 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:36.827079    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmk47_ef0df92f-67c0-430e-ba0f-922dd4e6fefc/ovnkube-controller/0.log"
Sep 18 17:07:38.067379 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:38.067352    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ch6l6_611a5dfd-7899-4ad7-8729-4def26a816b1/network-check-target-container/0.log"
Sep 18 17:07:39.093809 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:39.093781    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zbhmz_c0c3628a-ed78-4b82-aa08-fd60e372fec9/iptables-alerter/0.log"
Sep 18 17:07:39.801591 ip-10-0-128-224 kubenswrapper[2552]: I0918 17:07:39.801522    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-l26z5_a86ddc9e-bec5-4042-bf08-ea934285eedb/tuned/0.log"