Jul 16 17:12:02.066652 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 17:12:02.066664 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 17:12:02.066670 ip-10-0-128-42 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 17:12:02.066906 ip-10-0-128-42 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 17:12:11.444957 ip-10-0-128-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 17:12:11.444970 ip-10-0-128-42 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1b1efaab1f0342259a6d86919426d7b1 --
Jul 16 17:13:49.159349 ip-10-0-128-42 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 17:13:49.606807 ip-10-0-128-42 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:13:49.606807 ip-10-0-128-42 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 17:13:49.606807 ip-10-0-128-42 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:13:49.606807 ip-10-0-128-42 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 17:13:49.606807 ip-10-0-128-42 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:13:49.609649 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.609563    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 17:13:49.614928 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614911    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.614928 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614927    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.614928 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614931    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614934    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614937    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614939    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614943    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614946    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614949    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614952    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614954    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614957    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614960    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614963    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614966    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614968    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614971    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614973    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614976    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614978    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614981    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614984    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.615024 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614987    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614990    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614992    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614995    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614997    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.614999    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615002    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615005    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615007    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615010    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615012    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615015    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615018    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615023    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615027    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615030    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615033    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615036    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615039    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615042    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.615525 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615045    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615048    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615051    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615053    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615056    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615059    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615061    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615064    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615066    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615069    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615072    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615075    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615077    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615080    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615083    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615085    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615088    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615090    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615093    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615095    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.615999 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615098    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615100    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615118    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615129    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615133    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615136    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615139    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615142    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615144    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615157    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615160    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615163    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615165    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615168    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615170    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615173    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615176    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615178    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615181    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615186    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.616493 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615188    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615191    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615193    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615196    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615198    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615201    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615204    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615206    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615209    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615211    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615216    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615220    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615224    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615227    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615231    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615234    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.615238    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616074    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616083    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.616963 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616087    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616089    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616092    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616095    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616098    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616119    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616123    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616128    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616131    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616134    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616136    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616139    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616141    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616144    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616148    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616152    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616155    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616158    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616161    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.617506 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616163    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616167    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616171    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616174    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616177    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616180    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616183    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616186    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616188    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616191    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616194    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616197    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616200    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616202    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616205    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616208    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616210    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616214    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616216    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.617968 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616219    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616221    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616224    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616226    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616228    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616231    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616233    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616236    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616240    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616242    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616245    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616247    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616250    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616252    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616255    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616258    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616260    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616263    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616265    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616268    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.618441 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616271    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616273    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616276    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616278    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616281    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616283    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616286    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616288    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616291    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616293    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616296    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616299    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616301    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616304    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616307    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616309    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616311    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616314    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616316    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616319    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.618917 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616323    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616326    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616329    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616331    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616333    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616336    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616338    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616341    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616343    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616346    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616348    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616351    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616353    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616356    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616359    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616362    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616366    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616369    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616371    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.619421 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616754    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616759    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616761    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616767    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616770    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616773    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616776    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616778    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616781    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616784    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616786    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616789    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616792    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616794    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616796    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616799    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616802    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616804    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616807    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616809    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.619878 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616812    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616815    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616817    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616820    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616822    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616825    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616829    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616832    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616834    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616837    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616840    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616843    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616847    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616851    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616854    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616858    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616861    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616865    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616869    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.620379 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616871    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616874    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616878    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616880    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616883    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616886    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616889    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616892    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616894    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616897    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616899    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616902    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616904    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616907    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616909    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616913    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616917    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616919    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616922    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616925    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.620861 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616928    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616930    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616933    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616935    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616938    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616940    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616943    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616945    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616949    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616951    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616954    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616957    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616960    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616962    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616965    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616967    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616970    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616972    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616975    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.621390 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616978    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616980    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616984    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616987    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616991    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616994    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616996    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.616999    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617001    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617004    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617006    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617009    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617012    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617015    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617017    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617020    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617022    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617025    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617027    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.621837 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617030    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617032    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617120    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617127    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617133    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617137    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617144    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617147    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617153    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617159    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617162    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617165    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617168    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617173    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617178    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617181    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617184    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617187    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617190    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617193    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617197    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617199    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617202    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617205    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 17:13:49.622362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617209    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617214    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617216    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617219    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617222    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617225    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617228    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617231    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617234    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617237    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617241    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617244    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617247    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617250    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617253    2555 flags.go:64] FLAG: --enable-server="true"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617256    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617261    2555 flags.go:64] FLAG: --event-burst="100"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617264    2555 flags.go:64] FLAG: --event-qps="50"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617267    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617270    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617273    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617277    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617279    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617282    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617285    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 16 17:13:49.622916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617288    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617291    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617294    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617297    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617299    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617302    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617305    2555 flags.go:64] FLAG: --feature-gates=""
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617308    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617313    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617316    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617319    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617322    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617325    2555 flags.go:64] FLAG: --help="false"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617328    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617331    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617333    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617336    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617340    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617343    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617346    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617349    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617351    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617354    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 17:13:49.623540 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617358    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617361    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617363    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617366    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617369    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617372    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617375    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617377    2555 flags.go:64] FLAG: --lock-file=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617380    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617383    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617386    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617391    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617393    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617397    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617400    2555 flags.go:64] FLAG: --logging-format="text"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617403    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617406    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617410    2555 flags.go:64] FLAG: --manifest-url=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617413    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617417    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617420    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617424    2555 flags.go:64] FLAG: --max-pods="110"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617427    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617430    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617433    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 17:13:49.624281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617436    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617439    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617442    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617445    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617453    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617456    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617459    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617462    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617473    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617479    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617482    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617485    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617487    2555 flags.go:64] FLAG: --port="10250"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617490    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617493    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f16e9879d7a50d2"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617496    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617499    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617502    2555 flags.go:64] FLAG: --register-node="true"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617505    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617508    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617511    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617514    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617518    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617521    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617524    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 17:13:49.624880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617528    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617531    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617534    2555 flags.go:64] FLAG: --runonce="false"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617537    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617540    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617543    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617546    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617549    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617553    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617556    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617559    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617562    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617564    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617567    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617570    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617573    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617576    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617579    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617584    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617587    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617590    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617594    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617596    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617599    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617602    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 17:13:49.625529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617605    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617608    2555 flags.go:64] FLAG: --v="2"
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617611    2555 flags.go:64] FLAG: --version="false"
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617616    2555 flags.go:64] FLAG: --vmodule=""
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617619    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.617622    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617749    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617754    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617757    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617760    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617763    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617767    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617770    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617773    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617776    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617780    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617783    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617785    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617788    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617790    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.626121 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617793    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617796    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617799    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617801    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617804    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617807    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617809    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617812    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617814    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617817    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617819    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617821    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617824    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617826    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617829    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617831    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617835    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617838    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617841    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617845    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.626599 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617848    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617850    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617853    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617855    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617858    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617860    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617863    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617867    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617869    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617872    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617874    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617877    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617880    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617882    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617885    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617887    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617890    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617893    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617895    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617898    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.627080 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617900    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617903    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617905    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617908    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617910    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617913    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617915    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617918    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617920    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617923    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617925    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617930    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617933    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617935    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617938    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617941    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617943    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617945    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617948    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617952    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.627633 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617955    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617957    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617960    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617962    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617964    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617967    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617970    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617972    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617975    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617977    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617980    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617983    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617985    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617988    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617990    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617993    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617996    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.617998    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618001    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618004    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.628213 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618007    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618010    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618012    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618016    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.618018    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.618734    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.625805    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.625819    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.625836    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.625842    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625904    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625909    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625913    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625916    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625918    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.628698 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625921    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625929    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625933    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625936    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625939    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625942    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625946    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625955    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625959    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625961    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625964    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625966    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625969    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625971    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625974    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625977    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625979    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625982    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625984    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.629135 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625987    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625989    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625992    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625994    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.625997    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626000    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626003    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626006    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626008    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626011    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626013    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626016    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626018    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626021    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626023    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626026    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626028    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626031    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626034    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626036    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.629645 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626039    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626046    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626049    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626051    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626054    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626056    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626058    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626061    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626063    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626066    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626068    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626070    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626073    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626075    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626078    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626080    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626082    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626085    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626088    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626090    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.630176 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626093    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626096    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626098    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626114    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626117    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626119    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626122    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626124    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626127    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626131    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626135    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626138    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626140    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626143    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626152    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626155    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626157    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626160    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626162    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626170    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.630676 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626173    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626175    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626178    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626180    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626183    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626185    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626187    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626190    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626193    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626196    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626199    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626201    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626204    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626206    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626208    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.631196 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.626213    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626370    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626374    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626377    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626380    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626382    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626385    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626388    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626390    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626393    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626395    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626398    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626406    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626409    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626411    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626414    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626418    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626421    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626424    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:13:49.631593 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626427    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626429    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626432    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626435    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626437    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626440    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626442    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626445    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626448    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626451    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626453    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626456    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626458    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626461    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626463    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626466    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626468    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626470    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626473    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626475    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626478    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:13:49.632044 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626480    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626482    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626485    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626487    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626490    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626497    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626500    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626502    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626504    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626507    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626509    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626512    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626514    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626516    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626519    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626521    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626523    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626526    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626530    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:13:49.632613 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626533    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626535    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626538    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626540    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626543    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626545    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626548    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626550    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626553    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626555    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626557    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626560    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626562    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626564    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626567    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626569    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626571    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626574    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626576    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626584    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:13:49.633087 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626587    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626589    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626592    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626594    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626596    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626599    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626601    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626604    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626606    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626609    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626611    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626614    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626617    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626619    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626621    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626624    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626627    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626629    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626631    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:13:49.633584 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626635    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:49.626638    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.626643    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.626750    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.629012    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.630578    2555 server.go:1019] "Starting client certificate rotation"
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.630699    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.630731    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:13:49.634059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.633493    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:13:49.637444 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.637424    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:13:49.649803 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.649784    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 16 17:13:49.652057 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.652041    2555 log.go:25] "Validated CRI v1 image API"
Jul 16 17:13:49.652886 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.652872    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 17:13:49.657069 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.657047    2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a52a9393-bd4f-45a9-90bd-4a6eb7453d10:/dev/nvme0n1p4 c0244b46-2efa-4dbf-a5d5-e0a3dd4967f7:/dev/nvme0n1p3]
Jul 16 17:13:49.657152 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.657068    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 17:13:49.663061 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.662948    2555 manager.go:216] Machine: {Timestamp:2026-07-16 17:13:49.661568602 +0000 UTC m=+0.376085275 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3081251 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20571f3f1580cfec74b687a3a04965 SystemUUID:ec20571f-3f15-80cf-ec74-b687a3a04965 BootID:1b1efaab-1f03-4225-9a6d-86919426d7b1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:1b:5f:c5:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:1b:5f:c5:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:7d:78:76:45:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 17:13:49.663061 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.663056    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 17:13:49.663197 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.663153    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 17:13:49.664377 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.664347    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 17:13:49.664539 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.664380    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 17:13:49.664608 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.664526    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:13:49.665289 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.665278    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 17:13:49.665327 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.665292    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 17:13:49.665327 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.665300    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:13:49.665327 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.665313    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:13:49.667166 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.667155    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 17:13:49.670713 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670702    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:13:49.670842 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670833    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 17:13:49.670873 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670861    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 17:13:49.670873 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670871    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 17:13:49.670929 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670898    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 17:13:49.670929 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670907    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 16 17:13:49.670929 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.670920    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 17:13:49.671296 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.671284    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:13:49.671356 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.671301    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:13:49.674304 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.674286    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 17:13:49.677843 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.677829    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 17:13:49.677918 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.677859    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 17:13:49.678050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678038    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 17:13:49.678094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678054    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 17:13:49.678094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678061    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 17:13:49.678094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678066    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 17:13:49.678094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678077    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 17:13:49.678094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678086    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 17:13:49.678696 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678687    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 17:13:49.678696 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678696    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678703    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678709    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678717    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678725    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678745    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 17:13:49.678762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.678750    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 17:13:49.681845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.681833    2555 server.go:1268] "Started kubelet"
Jul 16 17:13:49.681924 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.681899    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 17:13:49.681998 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.681920    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 17:13:49.682048 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.682016    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 17:13:49.682444 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.682414    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 17:13:49.682534 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.682461    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 17:13:49.682757 ip-10-0-128-42 systemd[1]: Started Kubernetes Kubelet.
Jul 16 17:13:49.686836 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.686809    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 17:13:49.686947 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.686865    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 17:13:49.688548 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.688529    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 17:13:49.690636 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.690611    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 17:13:49.693618 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.692576    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c2d47b979c4b17  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-16 17:13:49.681806103 +0000 UTC m=+0.396322767,LastTimestamp:2026-07-16 17:13:49.681806103 +0000 UTC m=+0.396322767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}"
Jul 16 17:13:49.695678 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.695655    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 17:13:49.695678 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.695674    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 17:13:49.695907 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.695889    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:49.696449 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696416    2555 factory.go:55] Registering systemd factory
Jul 16 17:13:49.696449 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696437    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 16 17:13:49.696642 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696627    2555 factory.go:153] Registering CRI-O factory
Jul 16 17:13:49.696702 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696647    2555 factory.go:223] Registration of the crio container factory successfully
Jul 16 17:13:49.696702 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696690    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 17:13:49.696820 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696711    2555 factory.go:103] Registering Raw factory
Jul 16 17:13:49.696820 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696726    2555 manager.go:1196] Started watching for new ooms in manager
Jul 16 17:13:49.696820 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696765    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 17:13:49.696932 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.696850    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 17:13:49.697057 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.697047    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 17:13:49.697197 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.697183    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 17:13:49.697250 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.697198    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 17:13:49.697307 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.697294    2555 manager.go:349] Starting recovery of all containers
Jul 16 17:13:49.706229 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.706068    2555 manager.go:354] Recovery completed
Jul 16 17:13:49.707375 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.707338    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 17:13:49.707472 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.707452    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 17:13:49.707624 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.707608    2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 16 17:13:49.710858 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.710845    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.712752 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.712734    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.712818 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.712764    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.712818 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.712774    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.713335 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713319    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 17:13:49.713335 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713331    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.713448 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713334    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 17:13:49.713448 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713381    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:13:49.713989 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713974    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.714050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.713999    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.714050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.714008    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.714581 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.714568    2555 policy_none.go:49] "None policy: Start"
Jul 16 17:13:49.714641 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.714591    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 17:13:49.714641 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.714609    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 17:13:49.715758 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.715745    2555 policy_none.go:47] "Start"
Jul 16 17:13:49.727073 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.727007    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c2d47b997477eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-16 17:13:49.712750571 +0000 UTC m=+0.427267239,LastTimestamp:2026-07-16 17:13:49.712750571 +0000 UTC m=+0.427267239,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}"
Jul 16 17:13:49.736478 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.736393    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c2d47b9974c041  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-42.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-16 17:13:49.712769089 +0000 UTC m=+0.427285754,LastTimestamp:2026-07-16 17:13:49.712769089 +0000 UTC m=+0.427285754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}"
Jul 16 17:13:49.744571 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.744553    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r84pj"
Jul 16 17:13:49.746340 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.746280    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c2d47b9974e31f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-42.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-16 17:13:49.712778015 +0000 UTC m=+0.427294680,LastTimestamp:2026-07-16 17:13:49.712778015 +0000 UTC m=+0.427294680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}"
Jul 16 17:13:49.753321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.753305    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r84pj"
Jul 16 17:13:49.756787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.756774    2555 manager.go:337] "Starting Device Plugin manager"
Jul 16 17:13:49.756845 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.756801    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 17:13:49.756845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.756814    2555 server.go:87] "Starting device plugin registration server"
Jul 16 17:13:49.757034 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.757022    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 17:13:49.757096 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.757038    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 17:13:49.757189 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.757126    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 17:13:49.757233 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.757202    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 17:13:49.757233 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.757210    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 17:13:49.757821 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.757739    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-42.ec2.internal.18c2d47b997477eb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-42.ec2.internal.18c2d47b997477eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-42.ec2.internal,UID:ip-10-0-128-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-42.ec2.internal,},FirstTimestamp:2026-07-16 17:13:49.712750571 +0000 UTC m=+0.427267239,LastTimestamp:2026-07-16 17:13:49.713988004 +0000 UTC m=+0.428504668,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-42.ec2.internal,}"
Jul 16 17:13:49.758451 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.758412    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 17:13:49.758525 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.758468    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:49.836973 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.836949    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 17:13:49.838265 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.838247    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 17:13:49.838321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.838294    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 17:13:49.838321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.838317    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 17:13:49.838392 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.838355    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 17:13:49.840481 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.840464    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:49.857363 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.857321    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.858285 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.858271    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.858348 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.858299    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.858348 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.858310    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.858348 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.858329    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.870899 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.870885    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.870958 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.870906    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-42.ec2.internal\": node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:49.883640 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.883621    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:49.938790 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.938772    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"]
Jul 16 17:13:49.938853 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.938839    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.940226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.940211    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.940290 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.940240    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.940290 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.940250    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.941578 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.941565    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.941686 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.941671    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.941738 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.941707    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.942579 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942564    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.942579 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942574    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.942682 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942596    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.942682 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942613    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.942682 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942596    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.942785 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.942683    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.943822 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.943806    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.943876 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.943833    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:49.944471 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.944459    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:49.944533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.944485    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:49.944533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.944500    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:49.963721 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.963699    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-42.ec2.internal\" not found" node="ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.967944 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.967928    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-42.ec2.internal\" not found" node="ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.983828 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:49.983808    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:49.999209 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.999188    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.999288 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.999212    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:49.999288 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:49.999229    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4706a1e4d7dbe616d691c397a7da5d56-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"4706a1e4d7dbe616d691c397a7da5d56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.083912 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.083878    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.100239 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4706a1e4d7dbe616d691c397a7da5d56-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"4706a1e4d7dbe616d691c397a7da5d56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.100306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100272    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4706a1e4d7dbe616d691c397a7da5d56-config\") pod \"kube-apiserver-proxy-ip-10-0-128-42.ec2.internal\" (UID: \"4706a1e4d7dbe616d691c397a7da5d56\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.100369 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.100369 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.100456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.100456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.100418    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/53b44defa3c3fa5375d289a5d1aa529f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal\" (UID: \"53b44defa3c3fa5375d289a5d1aa529f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.184702 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.184647    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.265170 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.265139    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.271500 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.271480    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:50.285284 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.285267    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.385598 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.385573    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.486110 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.486087    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.577864 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.577836    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:50.586535 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.586514    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.630089 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.630074    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 17:13:50.630580 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.630200    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:13:50.630580 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.630223    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:13:50.686603 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.686584    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.757196 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.757136    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:08:50 +0000 UTC" deadline="2028-01-27 07:05:13.453182109 +0000 UTC"
Jul 16 17:13:50.757196 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.757163    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13429h51m22.696023298s"
Jul 16 17:13:50.786710 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.786688    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.786814 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.786802    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:50.878049 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:50.878014    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4706a1e4d7dbe616d691c397a7da5d56.slice/crio-f69ddb6998c2147b27c40ebacf600d0a4e9eafadc44707a2f8f65a615a6b289f WatchSource:0}: Error finding container f69ddb6998c2147b27c40ebacf600d0a4e9eafadc44707a2f8f65a615a6b289f: Status 404 returned error can't find the container with id f69ddb6998c2147b27c40ebacf600d0a4e9eafadc44707a2f8f65a615a6b289f
Jul 16 17:13:50.878265 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:50.878244    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b44defa3c3fa5375d289a5d1aa529f.slice/crio-0a2eb3caf8be13bc487f61e94fa3f03ea151dfaa8e3aebe13ca112262698806c WatchSource:0}: Error finding container 0a2eb3caf8be13bc487f61e94fa3f03ea151dfaa8e3aebe13ca112262698806c: Status 404 returned error can't find the container with id 0a2eb3caf8be13bc487f61e94fa3f03ea151dfaa8e3aebe13ca112262698806c
Jul 16 17:13:50.881885 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.881873    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:13:50.887572 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:50.887556    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-42.ec2.internal\" not found"
Jul 16 17:13:50.922884 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.922862    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:13:50.924045 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.924027    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:13:50.924124 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.924059    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:13:50.924124 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.924069    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:13:50.948761 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.948744    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:50.996047 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:50.996022    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:51.020648 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.020607    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:13:51.021554 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.021543    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal"
Jul 16 17:13:51.032333 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.032319    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:13:51.671810 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.671770    2555 apiserver.go:52] "Watching apiserver"
Jul 16 17:13:51.679248 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.679212    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 17:13:51.680786 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.680744    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal","openshift-multus/multus-additional-cni-plugins-mzfvv","openshift-multus/network-metrics-daemon-zqljw","openshift-network-diagnostics/network-check-target-5w757","openshift-network-operator/iptables-alerter-2fzlm","kube-system/global-pull-secret-syncer-p4pp7","kube-system/konnectivity-agent-svjcb","openshift-cluster-node-tuning-operator/tuned-2qm5d","openshift-dns/node-resolver-lw9wb","openshift-image-registry/node-ca-cmsm5","openshift-multus/multus-lsdhr","openshift-ovn-kubernetes/ovnkube-node-xvjmz"]
Jul 16 17:13:51.682400 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.682377    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.683587 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.683565    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.685212 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.685173    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r9ts7\""
Jul 16 17:13:51.685316 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.685260    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.685594 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.685577    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.685693 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.685674    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 17:13:51.686099 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.686073    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.686551 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.686510    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 17:13:51.686657 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.686641    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pb258\""
Jul 16 17:13:51.686779 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.686764    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 17:13:51.686873 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.686854    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.687128 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.687111    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.687505 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.687486    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.688535 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.688517    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.688617 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.688593    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:13:51.690111 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690091    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:51.690205 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.690166    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:13:51.690466 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690443    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 17:13:51.690578 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690514    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.690693 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690675    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfsv5\""
Jul 16 17:13:51.690858 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690843    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 17:13:51.690858 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.690851    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.691059 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.691042    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 17:13:51.691132 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.691085    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 17:13:51.691380 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.691364    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 17:13:51.691466 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.691410    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hmzd2\""
Jul 16 17:13:51.691588 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.691566    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 17:13:51.692512 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.692427    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.694660 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.694641    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.694758 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.694706    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:13:51.695659 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.695638    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 17:13:51.695835 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.695819    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7gv4n\""
Jul 16 17:13:51.696015 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.695995    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 17:13:51.696593 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.696578    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 17:13:51.697404 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.697381    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.699238 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.699218    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.700037 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.700020    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.700147 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.700133    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bg6pc\""
Jul 16 17:13:51.700316 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.700289    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 17:13:51.700316 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.700305    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.701758 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.701742    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.702491 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.702448    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dqx82\""
Jul 16 17:13:51.702999 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.702979    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.704316 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.704288    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.706636 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706614    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-log-socket\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.706753 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706682    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovn-node-metrics-cert\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.706815 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706741    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.706815 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706794    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-registration-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.706905 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706854    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.706905 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706825    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.706991 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706910    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-run\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.706991 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-modprobe-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.707091 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.706993    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-host\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.707239 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-tuned\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.707385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6nxs\" (UniqueName: \"kubernetes.io/projected/22f4c910-cda0-4863-a64c-00d226b80419-kube-api-access-z6nxs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.707518 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707499    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-dbus\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.707768 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707746    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cnibin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.707859 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707801    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.707928 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707877    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-sys-fs\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.707928 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707912    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708047 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.707943    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-socket-dir-parent\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708047 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708026    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-kubelet\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708048    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rr8s\" (UniqueName: \"kubernetes.io/projected/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-kube-api-access-5rr8s\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708067    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.708155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708085    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-daemon-config\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708103    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-slash\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.708155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708120    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:51.708385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708204    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-bin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.708385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708250    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnt5s\" (UniqueName: \"kubernetes.io/projected/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-kube-api-access-dnt5s\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.708385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysconfig\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.708385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-kubernetes\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.708385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-lib-modules\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.708647 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708628    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.708726 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708707    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.708829 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708812    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.708893 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.708893 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708882    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-script-lib\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709001 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708906    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-netns\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709001 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708931    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-hostroot\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709001 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708954    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-conf-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709001 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.708978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbsr\" (UniqueName: \"kubernetes.io/projected/85cf11d2-007e-43ce-9d33-286f604549af-kube-api-access-8rbsr\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wd85\" (UniqueName: \"kubernetes.io/projected/d2c9e652-6e9c-4cb9-95b4-985e71257c66-kube-api-access-7wd85\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-multus\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709056    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-system-cni-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709080    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-os-release\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-system-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709128    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-systemd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-etc-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709212    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-ovn\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709237    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-socket-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-kubelet\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709362    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-var-lib-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-node-log\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709410    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-conf\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-tmp\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709458    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwnv7\" (UniqueName: \"kubernetes.io/projected/6a379b3e-2cb3-4461-9ed6-bffe780879de-kube-api-access-xwnv7\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709483    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c7330f2-66f9-47d0-877c-630b88a820c8-konnectivity-ca\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-netd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709532    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-config\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-systemd\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709582    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2c9e652-6e9c-4cb9-95b4-985e71257c66-iptables-alerter-script\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709617    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-k8s-cni-cncf-io\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.709670 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709643    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-bin\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ndmf\" (UniqueName: \"kubernetes.io/projected/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-kube-api-access-4ndmf\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-sys\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709747    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709795    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-kubelet-config\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709826    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-multus-certs\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-etc-kubernetes\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-env-overrides\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709928    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.709954    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c7330f2-66f9-47d0-877c-630b88a820c8-agent-certs\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710031    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2c9e652-6e9c-4cb9-95b4-985e71257c66-host-slash\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710064    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-os-release\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710089    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-netns\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710118    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cnibin\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.710478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-device-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.711336 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710236    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-systemd-units\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.711336 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cni-binary-copy\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.711336 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.710287    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-var-lib-kubelet\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.711336 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.711152    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 17:13:51.711547 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.711441    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 17:13:51.711737 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.711720    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzcvc\""
Jul 16 17:13:51.711921 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.711897    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 17:13:51.712140 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.712124    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gxcn8\""
Jul 16 17:13:51.722042 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.722019    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:13:51.745156 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.745136    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtx47"
Jul 16 17:13:51.772135 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.772104    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dtx47"
Jul 16 17:13:51.798724 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.798703    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 17:13:51.811257 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-lib-modules\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.811382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-tmp-dir\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.811382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811301    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811326    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-script-lib\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811376    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhct6\" (UniqueName: \"kubernetes.io/projected/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-kube-api-access-mhct6\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-netns\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811425    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-hostroot\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811449    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-conf-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbsr\" (UniqueName: \"kubernetes.io/projected/85cf11d2-007e-43ce-9d33-286f604549af-kube-api-access-8rbsr\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811504    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wd85\" (UniqueName: \"kubernetes.io/projected/d2c9e652-6e9c-4cb9-95b4-985e71257c66-kube-api-access-7wd85\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-multus\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811555    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-system-cni-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-os-release\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-system-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811630    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-systemd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811654    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-etc-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811680    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-ovn\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811707    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.811746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811734    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-socket-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811760    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811785    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-kubelet\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-var-lib-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811839    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-node-log\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811864    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-conf\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-tmp\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811926    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwnv7\" (UniqueName: \"kubernetes.io/projected/6a379b3e-2cb3-4461-9ed6-bffe780879de-kube-api-access-xwnv7\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811952    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c7330f2-66f9-47d0-877c-630b88a820c8-konnectivity-ca\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.811977    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-netd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812006    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-config\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-systemd\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2c9e652-6e9c-4cb9-95b4-985e71257c66-iptables-alerter-script\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-k8s-cni-cncf-io\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812110    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-bin\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812140    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ndmf\" (UniqueName: \"kubernetes.io/projected/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-kube-api-access-4ndmf\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812165    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.812484 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-sys\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-kubelet-config\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812288    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-multus-certs\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812314    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-etc-kubernetes\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-env-overrides\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812368    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812397    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c7330f2-66f9-47d0-877c-630b88a820c8-agent-certs\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2c9e652-6e9c-4cb9-95b4-985e71257c66-host-slash\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812447    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-os-release\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-netns\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812500    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812529    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cnibin\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-device-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-systemd-units\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812610    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cni-binary-copy\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-var-lib-kubelet\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.813359 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812665    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-hosts-file\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-log-socket\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812721    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovn-node-metrics-cert\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812777    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-registration-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812805    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812833    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-run\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-modprobe-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812884    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-host\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812925    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-tuned\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812955    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6nxs\" (UniqueName: \"kubernetes.io/projected/22f4c910-cda0-4863-a64c-00d226b80419-kube-api-access-z6nxs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.812991    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-dbus\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813024    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cnibin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813055    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813085    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-sys-fs\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-serviceca\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.814216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813204    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-socket-dir-parent\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813237    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-kubelet\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813265    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rr8s\" (UniqueName: \"kubernetes.io/projected/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-kube-api-access-5rr8s\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813294    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813323    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzb2\" (UniqueName: \"kubernetes.io/projected/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-kube-api-access-xbzb2\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813352    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-daemon-config\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813380    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-slash\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813406    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-host\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813455    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813560    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-kubelet-config\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813613    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-etc-kubernetes\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.813696    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.813466    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-bin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814095    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-bin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-env-overrides\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814750    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814850    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2c9e652-6e9c-4cb9-95b4-985e71257c66-host-slash\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.815084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814910    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-os-release\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814944    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-netns\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.814980    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815008    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cnibin\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815038    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-device-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815086    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-systemd-units\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815086    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815605    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cni-binary-copy\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815671    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-var-lib-kubelet\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.815911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.815731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-log-socket\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.817306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.816681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.817306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.816794    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-lib-modules\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.817306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.816858    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-run-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.817306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.816899    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.817524 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.817423    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-script-lib\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.817524 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.817479    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-netns\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.817524 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.817516    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-hostroot\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.817681 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.817546    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-conf-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.818153 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818112    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-cni-multus\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.818246 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-system-cni-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.818310 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818298    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-os-release\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.818393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818371    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-system-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.818456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818412    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-systemd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.818515 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818470    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-etc-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.818602 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818525    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-run-ovn\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.818662 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818617    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-netd\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.818774 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.818750    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-socket-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.818846 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.818831    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:51.818911 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.818898    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:13:52.318877779 +0000 UTC m=+3.033394449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:51.819118 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819096    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-kubelet\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.819212 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-var-lib-openvswitch\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.819258 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819211    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-node-log\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.819339 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysctl-conf\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.819339 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-cni-bin\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.819498 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c7330f2-66f9-47d0-877c-630b88a820c8-agent-certs\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.819593 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819570    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovn-node-metrics-cert\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819759    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnt5s\" (UniqueName: \"kubernetes.io/projected/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-kube-api-access-dnt5s\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819795    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysconfig\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819852    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-kubernetes\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819857    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-sysconfig\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-ovnkube-config\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819907    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-sys\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819979    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-systemd\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.819986    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-multus-certs\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820055    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-registration-dir\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-etc-selinux\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820224    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-run\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820274    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-var-lib-kubelet\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820309    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-modprobe-d\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820360    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-host\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c7330f2-66f9-47d0-877c-630b88a820c8-konnectivity-ca\") pod \"konnectivity-agent-svjcb\" (UID: \"6c7330f2-66f9-47d0-877c-630b88a820c8\") " pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:51.822095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.820749    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:13:52.320725395 +0000 UTC m=+3.035242068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.820913    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0e38676-4590-413a-8a6a-d06077f8aa5d-dbus\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821347    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-daemon-config\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821412    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-kubernetes\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821456    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-host-run-k8s-cni-cncf-io\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821478    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cf11d2-007e-43ce-9d33-286f604549af-sys-fs\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821509    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-socket-dir-parent\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-cnibin\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821567    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-host-slash\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821709    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-multus-cni-dir\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.821984    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-tmp\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.822048    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.822149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2c9e652-6e9c-4cb9-95b4-985e71257c66-iptables-alerter-script\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.823093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.823071    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a379b3e-2cb3-4461-9ed6-bffe780879de-etc-tuned\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.834225 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.834137    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbsr\" (UniqueName: \"kubernetes.io/projected/85cf11d2-007e-43ce-9d33-286f604549af-kube-api-access-8rbsr\") pod \"aws-ebs-csi-driver-node-7pfwh\" (UID: \"85cf11d2-007e-43ce-9d33-286f604549af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:51.834760 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.834735    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wd85\" (UniqueName: \"kubernetes.io/projected/d2c9e652-6e9c-4cb9-95b4-985e71257c66-kube-api-access-7wd85\") pod \"iptables-alerter-2fzlm\" (UID: \"d2c9e652-6e9c-4cb9-95b4-985e71257c66\") " pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:51.839102 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.839079    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:13:51.839213 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.839110    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:13:51.839213 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.839124    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:51.839336 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:51.839267    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:13:52.339247798 +0000 UTC m=+3.053764468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:51.839645 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.839622    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rr8s\" (UniqueName: \"kubernetes.io/projected/457bafa8-6bf9-4cd0-bd16-c89251a1ecee-kube-api-access-5rr8s\") pod \"multus-lsdhr\" (UID: \"457bafa8-6bf9-4cd0-bd16-c89251a1ecee\") " pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:51.839853 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.839827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ndmf\" (UniqueName: \"kubernetes.io/projected/0b3f6f96-a7cd-491f-bf43-18f362dc6b11-kube-api-access-4ndmf\") pod \"ovnkube-node-xvjmz\" (UID: \"0b3f6f96-a7cd-491f-bf43-18f362dc6b11\") " pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:51.840533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.840512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnt5s\" (UniqueName: \"kubernetes.io/projected/c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c-kube-api-access-dnt5s\") pod \"multus-additional-cni-plugins-mzfvv\" (UID: \"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c\") " pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:51.844253 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.844231    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6nxs\" (UniqueName: \"kubernetes.io/projected/22f4c910-cda0-4863-a64c-00d226b80419-kube-api-access-z6nxs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:51.844829 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.844778    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"53b44defa3c3fa5375d289a5d1aa529f","Type":"ContainerStarted","Data":"0a2eb3caf8be13bc487f61e94fa3f03ea151dfaa8e3aebe13ca112262698806c"}
Jul 16 17:13:51.845930 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.845906    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwnv7\" (UniqueName: \"kubernetes.io/projected/6a379b3e-2cb3-4461-9ed6-bffe780879de-kube-api-access-xwnv7\") pod \"tuned-2qm5d\" (UID: \"6a379b3e-2cb3-4461-9ed6-bffe780879de\") " pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:51.846592 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.846563    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" event={"ID":"4706a1e4d7dbe616d691c397a7da5d56","Type":"ContainerStarted","Data":"f69ddb6998c2147b27c40ebacf600d0a4e9eafadc44707a2f8f65a615a6b289f"}
Jul 16 17:13:51.921241 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-serviceca\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.921393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921248    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzb2\" (UniqueName: \"kubernetes.io/projected/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-kube-api-access-xbzb2\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.921393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921277    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-host\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.921393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921312    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-tmp-dir\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.921393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhct6\" (UniqueName: \"kubernetes.io/projected/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-kube-api-access-mhct6\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.921539 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921414    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-hosts-file\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.921574 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921551    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-hosts-file\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.921997 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.921950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-serviceca\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.922424 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.922404    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-host\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.922530 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.922484    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-tmp-dir\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.935977 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.935929    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzb2\" (UniqueName: \"kubernetes.io/projected/0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9-kube-api-access-xbzb2\") pod \"node-ca-cmsm5\" (UID: \"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9\") " pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:51.940653 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.940629    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhct6\" (UniqueName: \"kubernetes.io/projected/68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7-kube-api-access-mhct6\") pod \"node-resolver-lw9wb\" (UID: \"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7\") " pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:51.997745 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:51.997718    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2fzlm"
Jul 16 17:13:52.008009 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.007976    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c9e652_6e9c_4cb9_95b4_985e71257c66.slice/crio-9c3e559b7ab544991b7141e830e22254f68e95ae2600f2b5b9e9e135932928f5 WatchSource:0}: Error finding container 9c3e559b7ab544991b7141e830e22254f68e95ae2600f2b5b9e9e135932928f5: Status 404 returned error can't find the container with id 9c3e559b7ab544991b7141e830e22254f68e95ae2600f2b5b9e9e135932928f5
Jul 16 17:13:52.011908 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.011886    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzfvv"
Jul 16 17:13:52.018269 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.018245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lsdhr"
Jul 16 17:13:52.022247 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.022221    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dae03c_89fe_4ea0_a4a6_8fb59c8c234c.slice/crio-ba7730dab68dbf0fe1f0a1511e17ea12d6d8ef7e46d7d4efcea28bcd54971e36 WatchSource:0}: Error finding container ba7730dab68dbf0fe1f0a1511e17ea12d6d8ef7e46d7d4efcea28bcd54971e36: Status 404 returned error can't find the container with id ba7730dab68dbf0fe1f0a1511e17ea12d6d8ef7e46d7d4efcea28bcd54971e36
Jul 16 17:13:52.024511 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.024452    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:13:52.031871 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.031595    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:13:52.038501 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.038479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh"
Jul 16 17:13:52.042605 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.042577    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7330f2_66f9_47d0_877c_630b88a820c8.slice/crio-67143ec3d1cffa65822c59da36fec14c648217318c4a07e09466f42a5bc0f365 WatchSource:0}: Error finding container 67143ec3d1cffa65822c59da36fec14c648217318c4a07e09466f42a5bc0f365: Status 404 returned error can't find the container with id 67143ec3d1cffa65822c59da36fec14c648217318c4a07e09466f42a5bc0f365
Jul 16 17:13:52.045845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.045821    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qm5d"
Jul 16 17:13:52.048412 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.048382    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cf11d2_007e_43ce_9d33_286f604549af.slice/crio-ce500efd4db968d44f7859cae874351a7bb43ea6bf70ec556cfe1bac11646679 WatchSource:0}: Error finding container ce500efd4db968d44f7859cae874351a7bb43ea6bf70ec556cfe1bac11646679: Status 404 returned error can't find the container with id ce500efd4db968d44f7859cae874351a7bb43ea6bf70ec556cfe1bac11646679
Jul 16 17:13:52.051596 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.051449    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw9wb"
Jul 16 17:13:52.055815 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.055671    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cmsm5"
Jul 16 17:13:52.065678 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.065467    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ae846b_e55f_46e5_bd3d_3f5b29a1a7d7.slice/crio-c10f2e5cb41a5cdacf9e02a7709214b9e2aafb55fae408f840b1bc33b4e38bc6 WatchSource:0}: Error finding container c10f2e5cb41a5cdacf9e02a7709214b9e2aafb55fae408f840b1bc33b4e38bc6: Status 404 returned error can't find the container with id c10f2e5cb41a5cdacf9e02a7709214b9e2aafb55fae408f840b1bc33b4e38bc6
Jul 16 17:13:52.072288 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:13:52.072261    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a560d8c_d4ff_40c6_8b71_cf3969fdd3a9.slice/crio-3c6364d37dc66059f89f46b59a84ed042a9e749bf18cfb0f05b273e90a255ce3 WatchSource:0}: Error finding container 3c6364d37dc66059f89f46b59a84ed042a9e749bf18cfb0f05b273e90a255ce3: Status 404 returned error can't find the container with id 3c6364d37dc66059f89f46b59a84ed042a9e749bf18cfb0f05b273e90a255ce3
Jul 16 17:13:52.137918 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.137891    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:52.324530 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.324494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:52.324708 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.324552    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:52.324708 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.324693    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:52.324796 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.324722    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:52.324796 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.324746    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:13:53.324732327 +0000 UTC m=+4.039248979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:52.324796 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.324790    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:13:53.324771405 +0000 UTC m=+4.039288063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:52.425574 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.425530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:52.425740 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.425683    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:13:52.425740 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.425700    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:13:52.425740 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.425709    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:52.425875 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.425763    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:13:53.425748794 +0000 UTC m=+4.140265448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:52.774609 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.774563    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:08:52 +0000 UTC" deadline="2028-03-26 08:57:54.260972986 +0000 UTC"
Jul 16 17:13:52.774609 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.774613    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14847h44m1.486371693s"
Jul 16 17:13:52.839433 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.839405    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:52.839618 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:52.839536    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:13:52.850387 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.850350    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw9wb" event={"ID":"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7","Type":"ContainerStarted","Data":"c10f2e5cb41a5cdacf9e02a7709214b9e2aafb55fae408f840b1bc33b4e38bc6"}
Jul 16 17:13:52.851837 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.851790    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qm5d" event={"ID":"6a379b3e-2cb3-4461-9ed6-bffe780879de","Type":"ContainerStarted","Data":"2ff36ddaf7c296b5aabecfb655175972fe4543cd8a39250ab4288eb0e2f9b51e"}
Jul 16 17:13:52.853310 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.853281    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh" event={"ID":"85cf11d2-007e-43ce-9d33-286f604549af","Type":"ContainerStarted","Data":"ce500efd4db968d44f7859cae874351a7bb43ea6bf70ec556cfe1bac11646679"}
Jul 16 17:13:52.854751 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.854724    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cmsm5" event={"ID":"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9","Type":"ContainerStarted","Data":"3c6364d37dc66059f89f46b59a84ed042a9e749bf18cfb0f05b273e90a255ce3"}
Jul 16 17:13:52.856348 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.856314    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svjcb" event={"ID":"6c7330f2-66f9-47d0-877c-630b88a820c8","Type":"ContainerStarted","Data":"67143ec3d1cffa65822c59da36fec14c648217318c4a07e09466f42a5bc0f365"}
Jul 16 17:13:52.857902 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.857878    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"3d1fab33f012ef8b89379a596a65ded35bc21fa58fdad165677870de2102057a"}
Jul 16 17:13:52.861218 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.861170    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsdhr" event={"ID":"457bafa8-6bf9-4cd0-bd16-c89251a1ecee","Type":"ContainerStarted","Data":"48ed39342992038f61ceda9ca76c3136c8a59e3b27853ac7d3db649e64523e2e"}
Jul 16 17:13:52.863435 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.863282    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerStarted","Data":"ba7730dab68dbf0fe1f0a1511e17ea12d6d8ef7e46d7d4efcea28bcd54971e36"}
Jul 16 17:13:52.864999 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.864974    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2fzlm" event={"ID":"d2c9e652-6e9c-4cb9-95b4-985e71257c66","Type":"ContainerStarted","Data":"9c3e559b7ab544991b7141e830e22254f68e95ae2600f2b5b9e9e135932928f5"}
Jul 16 17:13:52.956847 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:52.956812    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:13:53.333306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.333025    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:53.333474 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.333336    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:53.333536 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.333478    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:53.333591 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.333545    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:13:55.333523284 +0000 UTC m=+6.048039955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:53.334003 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.333983    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:53.334072 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.334041    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:13:55.334027573 +0000 UTC m=+6.048544232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:53.434577 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.434506    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:53.434820 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.434768    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:13:53.434820 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.434806    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:13:53.434820 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.434821    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:53.434997 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.434884    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:13:55.434864627 +0000 UTC m=+6.149381301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:53.775739 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.775635    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:08:52 +0000 UTC" deadline="2028-04-21 11:17:50.478528662 +0000 UTC"
Jul 16 17:13:53.775739 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.775709    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15474h3m56.702825509s"
Jul 16 17:13:53.840036 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.839317    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:53.840036 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.839476    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:13:53.840036 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.839840    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:53.840036 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:53.839944    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:13:53.875597 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:53.874922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" event={"ID":"4706a1e4d7dbe616d691c397a7da5d56","Type":"ContainerStarted","Data":"5a406c1d7ee3c3e497c829c3cc58a684939223874b6841cf8bed8228065b63ce"}
Jul 16 17:13:54.839472 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:54.839438    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:54.840019 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:54.839582    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:13:54.884386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:54.884347    2555 generic.go:356] "Generic (PLEG): container finished" podID="53b44defa3c3fa5375d289a5d1aa529f" containerID="d75422001abf1cf061b8519be8fa1a73614b262ababe81ba3a9e8fb76b3cc3fa" exitCode=0
Jul 16 17:13:54.885210 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:54.885158    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"53b44defa3c3fa5375d289a5d1aa529f","Type":"ContainerDied","Data":"d75422001abf1cf061b8519be8fa1a73614b262ababe81ba3a9e8fb76b3cc3fa"}
Jul 16 17:13:54.905746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:54.904835    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-42.ec2.internal" podStartSLOduration=3.9048142820000002 podStartE2EDuration="3.904814282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:13:53.894239578 +0000 UTC m=+4.608756255" watchObservedRunningTime="2026-07-16 17:13:54.904814282 +0000 UTC m=+5.619330962"
Jul 16 17:13:55.350729 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:55.350689    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:55.350933 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:55.350750    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:55.350933 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.350914    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:55.351062 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.350984    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:13:59.350962941 +0000 UTC m=+10.065479603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:55.351483 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.351459    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:55.351572 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.351525    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:13:59.351506576 +0000 UTC m=+10.066023244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:55.452093 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:55.451390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:55.452093 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.451621    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:13:55.452093 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.451640    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:13:55.452093 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.451654    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:55.452093 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.451727    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:13:59.451693834 +0000 UTC m=+10.166210502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:55.840321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:55.840292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:55.840821 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.840440    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:13:55.840995 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:55.840969    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:55.841109 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:55.841083    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:13:56.838875 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:56.838836    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:56.839069 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:56.839006    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:13:57.838734 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:57.838703    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:57.839282 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:57.838825    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:13:57.839282 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:57.839204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:57.839412 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:57.839323    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:13:58.839381 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:58.839337    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:58.839852 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:58.839474    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:13:59.389139 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:59.389066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:13:59.389139 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:59.389123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:59.389366 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.389280    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:59.389366 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.389325    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:59.389366 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.389354    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:07.389333546 +0000 UTC m=+18.103850201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:13:59.389493 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.389399    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:14:07.389374995 +0000 UTC m=+18.103891671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:13:59.490091 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:59.490048    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:59.490282 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.490254    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:13:59.490282 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.490279    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:13:59.490404 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.490295    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:59.490404 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.490371    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:14:07.490351226 +0000 UTC m=+18.204867900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:13:59.839701 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:59.839669    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:13:59.840073 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.839798    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:13:59.840303 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:13:59.840280    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:13:59.840430 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:13:59.840408    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:00.839964 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:00.839331    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:00.839964 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:00.839577    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:01.839453 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:01.839418    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:01.839453 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:01.839460    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:01.839706 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:01.839559    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:01.839770 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:01.839700    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:02.838905 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:02.838442    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:02.838905 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:02.838577    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:03.838724 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:03.838682    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:03.838904 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:03.838813    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:03.838904 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:03.838871    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:03.839249 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:03.838963    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:04.839788 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:04.839319    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:04.839788 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:04.839441    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:05.839143 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:05.838675    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:05.839143 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:05.838681    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:05.839143 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:05.838810    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:05.839143 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:05.838934    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:06.838742 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:06.838703    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:06.839220 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:06.838840    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:07.449072 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:07.449034    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:07.449259 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:07.449096    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:07.449259 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.449183    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:14:07.449259 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.449249    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:14:07.449259 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.449259    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:14:23.449240445 +0000 UTC m=+34.163757100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:14:07.449470 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.449304    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:23.449285651 +0000 UTC m=+34.163802308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:14:07.550434 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:07.550361    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:07.550597 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.550550    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:14:07.550597 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.550573    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:14:07.550597 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.550585    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:14:07.550739 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.550651    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:14:23.550633304 +0000 UTC m=+34.265149961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:14:07.839042 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:07.838964    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:07.839472 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:07.838973    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:07.839472 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.839121    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:07.839472 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:07.839215    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:08.839076 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:08.839039    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:08.839537 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:08.839174    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:09.839543 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:09.839504    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:09.839543 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:09.839545    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:09.840070 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:09.839624    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:09.840070 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:09.839792    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:10.838645 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:10.838612    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:10.838813 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:10.838705    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:11.840911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.840380    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:11.840911 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:11.840693    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:11.840911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.840768    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:11.840911 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:11.840873    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:11.924805 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.924767    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" event={"ID":"53b44defa3c3fa5375d289a5d1aa529f","Type":"ContainerStarted","Data":"092f811587e911553b9317618aa0e8c626a99264197c15172b9744ccf39f766a"}
Jul 16 17:14:11.937365 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.936640    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cmsm5" event={"ID":"0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9","Type":"ContainerStarted","Data":"1e3ccf6c17341e1c33e71e5b6529cc3ba224e77e1532b27de55ba5d58185d8fc"}
Jul 16 17:14:11.944170 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.944142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svjcb" event={"ID":"6c7330f2-66f9-47d0-877c-630b88a820c8","Type":"ContainerStarted","Data":"fd0ed8194179ea3d648f8461eebdd3715ea4ffc22f3ec3b17a8b156dab59b6cd"}
Jul 16 17:14:11.946060 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.946021    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-42.ec2.internal" podStartSLOduration=20.946007425 podStartE2EDuration="20.946007425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:11.945402542 +0000 UTC m=+22.659919216" watchObservedRunningTime="2026-07-16 17:14:11.946007425 +0000 UTC m=+22.660524099"
Jul 16 17:14:11.963619 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:11.963581    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-svjcb" podStartSLOduration=2.288014639 podStartE2EDuration="21.963565891s" totalImagesPullingTime="19.675551252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:11.963431606 +0000 UTC m=+22.677948280" watchObservedRunningTime="2026-07-16 17:14:11.963565891 +0000 UTC m=+22.678082564"
Jul 16 17:14:12.225853 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.225825    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:14:12.226556 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.226538    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:14:12.839394 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.839231    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:12.839552 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:12.839480    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:12.947372 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.947336    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw9wb" event={"ID":"68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7","Type":"ContainerStarted","Data":"ac0d65a492079a765e671e04f44a77bac9d8254ea2fc0da0db15a56789b8d321"}
Jul 16 17:14:12.948985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.948959    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qm5d" event={"ID":"6a379b3e-2cb3-4461-9ed6-bffe780879de","Type":"ContainerStarted","Data":"d4c1337745c583baacb2004da23c103f6e7fa30a0a32b901261ed6c5a26b5b8f"}
Jul 16 17:14:12.950493 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.950460    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh" event={"ID":"85cf11d2-007e-43ce-9d33-286f604549af","Type":"ContainerStarted","Data":"7f5fac846cc7406c51fad52ed3771380d41d00d6c0ae9e070e7fb494847c3c54"}
Jul 16 17:14:12.953356 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953337    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:14:12.953694 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953675    2555 generic.go:356] "Generic (PLEG): container finished" podID="0b3f6f96-a7cd-491f-bf43-18f362dc6b11" containerID="6a0cfd09f1abe28d7f73aedb9ac57fd7c13b2a551f5b56bcfaa6506848ba0e89" exitCode=1
Jul 16 17:14:12.953778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953749    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"8b44d63d2ba3a32bffe4f96b05c727826b82f7cd11bb9fcec0ef2fb154c79a92"}
Jul 16 17:14:12.953833 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953823    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"e6401aeb9e0e65e7f8458208a8592be07fa7de92ddc0c283982674bdfdfdfbcb"}
Jul 16 17:14:12.953879 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953866    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"3767857f188948f069ae553ac1387add64895c1449602780d06cb81b8ddb7779"}
Jul 16 17:14:12.953921 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953912    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"414626f68eb22007d7501f14873dd4a7f4007f77d593452edcca91b445b30e0a"}
Jul 16 17:14:12.953974 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953946    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerDied","Data":"6a0cfd09f1abe28d7f73aedb9ac57fd7c13b2a551f5b56bcfaa6506848ba0e89"}
Jul 16 17:14:12.954022 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.953986    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"162b21bbd3d67c9547b8526667d8037c13a664c3a20e8d7d90dda2bef585e5f4"}
Jul 16 17:14:12.955416 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.955393    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lsdhr" event={"ID":"457bafa8-6bf9-4cd0-bd16-c89251a1ecee","Type":"ContainerStarted","Data":"4a652385f58ed76050df76f9d9b0561986fdd4eaa73df0c0ab189a28cb1a1e4a"}
Jul 16 17:14:12.957155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.957131    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="2e5c0e3848abd49ad4a4ead0b9d55183c6e7cc9a9c142684921be81de95bde4b" exitCode=0
Jul 16 17:14:12.957250 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.957211    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"2e5c0e3848abd49ad4a4ead0b9d55183c6e7cc9a9c142684921be81de95bde4b"}
Jul 16 17:14:12.959246 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.959226    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2fzlm" event={"ID":"d2c9e652-6e9c-4cb9-95b4-985e71257c66","Type":"ContainerStarted","Data":"3e17e73a21f895b1ac8afab7d71bdd7e69af47516dbdb70acb4889f26a1448cf"}
Jul 16 17:14:12.960191 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.960172    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:14:12.960727 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:12.960713    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-svjcb"
Jul 16 17:14:13.010302 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.010238    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lw9wb" podStartSLOduration=3.358093894 podStartE2EDuration="23.010219006s" totalImagesPullingTime="19.652125112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:12.984941499 +0000 UTC m=+23.699458172" watchObservedRunningTime="2026-07-16 17:14:13.010219006 +0000 UTC m=+23.724735680"
Jul 16 17:14:13.010883 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.010843    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2fzlm" podStartSLOduration=3.300777094 podStartE2EDuration="23.010832218s" totalImagesPullingTime="19.710055124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:13.009850807 +0000 UTC m=+23.724367474" watchObservedRunningTime="2026-07-16 17:14:13.010832218 +0000 UTC m=+23.725348893"
Jul 16 17:14:13.097420 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.097344    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2qm5d" podStartSLOduration=3.41734967 podStartE2EDuration="23.097330812s" totalImagesPullingTime="19.679981142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:13.097260029 +0000 UTC m=+23.811776703" watchObservedRunningTime="2026-07-16 17:14:13.097330812 +0000 UTC m=+23.811847495"
Jul 16 17:14:13.125482 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.125441    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lsdhr" podStartSLOduration=3.385131961 podStartE2EDuration="23.125430266s" totalImagesPullingTime="19.740298305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:13.125263526 +0000 UTC m=+23.839780200" watchObservedRunningTime="2026-07-16 17:14:13.125430266 +0000 UTC m=+23.839946934"
Jul 16 17:14:13.144829 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.144790    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cmsm5" podStartSLOduration=3.499181755 podStartE2EDuration="23.14477924s" totalImagesPullingTime="19.645597485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:13.144349457 +0000 UTC m=+23.858866130" watchObservedRunningTime="2026-07-16 17:14:13.14477924 +0000 UTC m=+23.859295914"
Jul 16 17:14:13.541189 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.541166    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 17:14:13.770890 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.770805    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:14:13.541185996Z","UUID":"0daf0ecc-4ae3-48bf-8290-48283563503c","Handler":null,"Name":"","Endpoint":""}
Jul 16 17:14:13.772163 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.772147    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 17:14:13.772284 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.772183    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 17:14:13.838858 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.838832    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:13.838979 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:13.838933    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:13.839055 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.838987    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:13.839158 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:13.839073    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:13.962146 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:13.962091    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh" event={"ID":"85cf11d2-007e-43ce-9d33-286f604549af","Type":"ContainerStarted","Data":"47f977379cf2b5060a24dc8bc91a1abffd1aa740e52779d45ef015b71da93f1c"}
Jul 16 17:14:14.838619 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:14.838540    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:14.838749 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:14.838656    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:14.967062 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:14.967036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:14:14.967481 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:14.967437    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"6d6b6828080b7e814c57ec13bdfa8a2ef3b08eaab13665b32f7dd2e34ce87d8e"}
Jul 16 17:14:15.839200 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:15.839172    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:15.839200 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:15.839182    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:15.839428 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:15.839270    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:15.839428 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:15.839384    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:16.839195 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.839036    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:16.839832 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:16.839310    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:16.976439 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.976418    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:14:16.976838 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.976807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"4979389797ce5ef9ff199d849c905fe1083bfa3ce523b8d286927bb98cec7508"}
Jul 16 17:14:16.977154 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.977130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:16.977300 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.977209    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:16.977300 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.977260    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:16.977402 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.977313    2555 scope.go:117] "RemoveContainer" containerID="6a0cfd09f1abe28d7f73aedb9ac57fd7c13b2a551f5b56bcfaa6506848ba0e89"
Jul 16 17:14:16.993876 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.993852    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:16.994435 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:16.994330    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:17.839143 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:17.839095    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:17.839279 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:17.839155    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:17.839279 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:17.839250    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:17.839558 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:17.839358    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:17.983558 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:17.983529    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:14:17.984009 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:17.983980    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" event={"ID":"0b3f6f96-a7cd-491f-bf43-18f362dc6b11","Type":"ContainerStarted","Data":"c3ff4ca9f897e469dda362605a866ba7f9529c31bf0e661a74db2870d1bdb03b"}
Jul 16 17:14:17.986779 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:17.986749    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh" event={"ID":"85cf11d2-007e-43ce-9d33-286f604549af","Type":"ContainerStarted","Data":"692e2ae521ccd9cb290c6197f1f4601ec93a186ddd8fb58a6d76e1ad5e91fd62"}
Jul 16 17:14:18.066159 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:18.066099    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz" podStartSLOduration=8.294225715 podStartE2EDuration="28.066080526s" totalImagesPullingTime="19.771854811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:18.030124527 +0000 UTC m=+28.744641201" watchObservedRunningTime="2026-07-16 17:14:18.066080526 +0000 UTC m=+28.780597196"
Jul 16 17:14:18.066341 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:18.066314    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7pfwh" podStartSLOduration=3.56705803 podStartE2EDuration="28.066308223s" totalImagesPullingTime="24.499250193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:18.066048423 +0000 UTC m=+28.780565096" watchObservedRunningTime="2026-07-16 17:14:18.066308223 +0000 UTC m=+28.780824897"
Jul 16 17:14:18.839360 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:18.839334    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:18.839826 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:18.839442    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:19.110745 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.110655    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p4pp7"]
Jul 16 17:14:19.110897 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.110759    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:19.110897 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:19.110847    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:19.113214 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.113185    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqljw"]
Jul 16 17:14:19.113340 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.113284    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:19.113409 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:19.113389    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:19.113778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.113729    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5w757"]
Jul 16 17:14:19.113912 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:19.113815    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:19.113912 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:19.113888    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:20.838693 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:20.838658    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:20.839138 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:20.838806    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:20.839138 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:20.838823    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:20.839138 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:20.838835    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:20.839138 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:20.838910    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:20.839138 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:20.839004    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:22.839539 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:22.839316    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:22.840096 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:22.839364    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:22.840096 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:22.839569    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5w757" podUID="e46d077f-170c-4146-afc2-c307d9ebfa0b"
Jul 16 17:14:22.840096 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:22.839676    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p4pp7" podUID="c0e38676-4590-413a-8a6a-d06077f8aa5d"
Jul 16 17:14:22.840096 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:22.839370    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:22.840096 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:22.839772    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:14:23.001339 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:23.001309    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="7b78e8287d8971331a977b91f31ce45e87d5b79b80f8a726ad2ccd58d1304d43" exitCode=0
Jul 16 17:14:23.001466 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:23.001361    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"7b78e8287d8971331a977b91f31ce45e87d5b79b80f8a726ad2ccd58d1304d43"}
Jul 16 17:14:23.474254 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:23.474223    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:23.474254 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:23.474259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:23.474454 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.474349    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:14:23.474454 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.474352    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:14:23.474454 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.474402    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:55.474385409 +0000 UTC m=+66.188902062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:14:23.474454 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.474416    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret podName:c0e38676-4590-413a-8a6a-d06077f8aa5d nodeName:}" failed. No retries permitted until 2026-07-16 17:14:55.474410024 +0000 UTC m=+66.188926676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret") pod "global-pull-secret-syncer-p4pp7" (UID: "c0e38676-4590-413a-8a6a-d06077f8aa5d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:14:23.575507 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:23.575474    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:23.575685 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.575596    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:14:23.575685 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.575612    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:14:23.575685 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.575621    2555 projected.go:196] Error preparing data for projected volume kube-api-access-xpdvf for pod openshift-network-diagnostics/network-check-target-5w757: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:14:23.575685 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:23.575671    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf podName:e46d077f-170c-4146-afc2-c307d9ebfa0b nodeName:}" failed. No retries permitted until 2026-07-16 17:14:55.575655522 +0000 UTC m=+66.290172184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xpdvf" (UniqueName: "kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf") pod "network-check-target-5w757" (UID: "e46d077f-170c-4146-afc2-c307d9ebfa0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:14:24.624833 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.624763    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-42.ec2.internal" event="NodeReady"
Jul 16 17:14:24.625357 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.624866    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 17:14:24.693386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.693357    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:14:24.708458 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.708435    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"]
Jul 16 17:14:24.708575 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.708563    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.718385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.718365    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"]
Jul 16 17:14:24.718513 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.718470    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.730363 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.730346    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"]
Jul 16 17:14:24.730466 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.730452    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.745146 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.745127    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"]
Jul 16 17:14:24.745227 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.745189    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.758258 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.758242    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.795601 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.795578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 17:14:24.795902 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.795884    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"]
Jul 16 17:14:24.804016 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.803992    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 17:14:24.804138 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.804027    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 17:14:24.806020 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.805989    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 17:14:24.806140 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.806072    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bqh7f\""
Jul 16 17:14:24.806140 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.805991    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 17:14:24.806739 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.806725    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dr8gm"]
Jul 16 17:14:24.808508 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.808492    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5dwz7"]
Jul 16 17:14:24.808612 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.808598    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:24.810281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.810266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:24.839436 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.839414    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:24.839573 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.839527    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:24.839573 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.839550    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:24.845539 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.845519    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 17:14:24.873435 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.873414    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 17:14:24.884065 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.884006    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 17:14:24.884619 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.884600    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 17:14:24.884874 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.884856    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"]
Jul 16 17:14:24.885413 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.885334    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 17:14:24.885491 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.885476    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 17:14:24.885549 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.885495    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 17:14:24.885863 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.885829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.886095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886070    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrjh\" (UniqueName: \"kubernetes.io/projected/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-kube-api-access-dkrjh\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.886224 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886130    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.886661 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886609    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.887658 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886833    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9kv\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.887658 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63cebda9-6aed-479d-888c-e85cec991785-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.887658 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.886997    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.887658 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.887269    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g26w2\" (UniqueName: \"kubernetes.io/projected/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-kube-api-access-g26w2\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.887658 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.887471    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.887966 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.887815    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 17:14:24.888122 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888327    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gtbr4\""
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888350    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888616    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923b862b-ab24-49a5-9e49-8e019c995808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.888898    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889068    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9hk7\" (UniqueName: \"kubernetes.io/projected/923b862b-ab24-49a5-9e49-8e019c995808-kube-api-access-v9hk7\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889138    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889153    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmt5\""
Jul 16 17:14:24.889280 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889229    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-tmp\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889303    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889263    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889393    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889427    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889548    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.889763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889695    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 17:14:24.890050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.889810    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 17:14:24.891341 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891316    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 17:14:24.891436 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891339    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:14:24.891436 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891378    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65bh8\""
Jul 16 17:14:24.891533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891317    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"]
Jul 16 17:14:24.891533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891464    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gn8hz\""
Jul 16 17:14:24.891533 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891514    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:14:24.891659 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891518    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 17:14:24.891659 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891566    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:14:24.891659 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891628    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9l5d5\""
Jul 16 17:14:24.891659 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891653    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2jtns\""
Jul 16 17:14:24.891885 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.891870    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 17:14:24.892350 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.892335    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"]
Jul 16 17:14:24.892947 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.892930    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr8gm"]
Jul 16 17:14:24.893456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.893443    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5dwz7"]
Jul 16 17:14:24.893979 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.893965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:14:24.906561 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.906544    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 17:14:24.990894 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.990863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.990894 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.990893    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrjh\" (UniqueName: \"kubernetes.io/projected/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-kube-api-access-dkrjh\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.991136 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.990911    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.991222 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g26w2\" (UniqueName: \"kubernetes.io/projected/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-kube-api-access-g26w2\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.991281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.991281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991266    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16a677d7-0578-462c-87dc-85668e7965a0-cert\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:24.991379 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-tmp-dir\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:24.991379 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991321    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2d5\" (UniqueName: \"kubernetes.io/projected/16a677d7-0578-462c-87dc-85668e7965a0-kube-api-access-lj2d5\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:24.991379 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991354    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.991555 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991381    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.991555 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991498    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-config-volume\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:24.991555 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991530    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9s8\" (UniqueName: \"kubernetes.io/projected/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-kube-api-access-kk9s8\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:24.991712 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923b862b-ab24-49a5-9e49-8e019c995808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.991712 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.991712 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-tmp\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.991712 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.991917 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:24.991917 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991781    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.991917 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9kv\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.991917 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991884    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63cebda9-6aed-479d-888c-e85cec991785-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.992092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991921    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.992092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991979    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-tmp\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.992092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.991983    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.992092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992043    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.992092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9hk7\" (UniqueName: \"kubernetes.io/projected/923b862b-ab24-49a5-9e49-8e019c995808-kube-api-access-v9hk7\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.992328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.992328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992155    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.992328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992154    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.992328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992176    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.992548 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:24.992426    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:24.992548 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:24.992444    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:24.992548 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:24.992498    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:25.492479055 +0000 UTC m=+36.206995707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:24.992779 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:24.992761    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:24.992837 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.992808    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.992837 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:24.992816    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:25.492801276 +0000 UTC m=+36.207317936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:24.993800 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.993769    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63cebda9-6aed-479d-888c-e85cec991785-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:24.993800 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.993791    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.994087 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.994065    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.996277 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996218    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.996277 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996236    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-ca\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.996437 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996380    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:24.996437 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996418    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.996555 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996536    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:24.996641 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996620    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923b862b-ab24-49a5-9e49-8e019c995808-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:24.996738 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.996724    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:24.997794 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:24.997770    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:25.000480 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.000454    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrjh\" (UniqueName: \"kubernetes.io/projected/db7cc385-b6ae-4198-8da2-41e22d0ca6b3-kube-api-access-dkrjh\") pod \"klusterlet-addon-workmgr-65b6555dd8-9chpq\" (UID: \"db7cc385-b6ae-4198-8da2-41e22d0ca6b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:25.000984 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.000965    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g26w2\" (UniqueName: \"kubernetes.io/projected/1718a1dc-41c3-41b8-a6e7-69e7ca375bc9-kube-api-access-g26w2\") pod \"cluster-proxy-proxy-agent-5d4ff7746b-lgm8t\" (UID: \"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:25.001489 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.001464    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:25.001991 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.001972    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9hk7\" (UniqueName: \"kubernetes.io/projected/923b862b-ab24-49a5-9e49-8e019c995808-kube-api-access-v9hk7\") pod \"managed-serviceaccount-addon-agent-5fd5fb5474-llbz4\" (UID: \"923b862b-ab24-49a5-9e49-8e019c995808\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:25.006459 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.006149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9kv\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:25.008464 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.008444    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="2abb7befae8e4d1f1a66dbca7b00a40e71c225a485a632ad252e34f6761684cd" exitCode=0
Jul 16 17:14:25.008555 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.008493    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"2abb7befae8e4d1f1a66dbca7b00a40e71c225a485a632ad252e34f6761684cd"}
Jul 16 17:14:25.035391 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.035373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:14:25.041193 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.041174    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"
Jul 16 17:14:25.072258 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.071978    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:25.080916 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.080881    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:25.093617 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16a677d7-0578-462c-87dc-85668e7965a0-cert\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:25.093746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093625    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-tmp-dir\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.093746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093644    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2d5\" (UniqueName: \"kubernetes.io/projected/16a677d7-0578-462c-87dc-85668e7965a0-kube-api-access-lj2d5\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:25.093746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093671    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-config-volume\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.093746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093693    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9s8\" (UniqueName: \"kubernetes.io/projected/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-kube-api-access-kk9s8\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.093746 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.093731    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.093965 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.093829    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:25.093965 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.093896    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:25.593877327 +0000 UTC m=+36.308393989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:25.094428 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.094405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-tmp-dir\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.094699 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.094681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-config-volume\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.103935 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.103582    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16a677d7-0578-462c-87dc-85668e7965a0-cert\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:25.107719 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.107581    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9s8\" (UniqueName: \"kubernetes.io/projected/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-kube-api-access-kk9s8\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.108957 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.108932    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2d5\" (UniqueName: \"kubernetes.io/projected/16a677d7-0578-462c-87dc-85668e7965a0-kube-api-access-lj2d5\") pod \"ingress-canary-dr8gm\" (UID: \"16a677d7-0578-462c-87dc-85668e7965a0\") " pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:25.119049 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.118803    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr8gm"
Jul 16 17:14:25.184785 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.184746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:25.203828 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.203118    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4"]
Jul 16 17:14:25.205604 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.205582    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"]
Jul 16 17:14:25.206695 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:14:25.206674    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod923b862b_ab24_49a5_9e49_8e019c995808.slice/crio-a702f8a17d1781c20acfd96edfcf439465bd1d6a3ae39125d6878dbe2973a82e WatchSource:0}: Error finding container a702f8a17d1781c20acfd96edfcf439465bd1d6a3ae39125d6878dbe2973a82e: Status 404 returned error can't find the container with id a702f8a17d1781c20acfd96edfcf439465bd1d6a3ae39125d6878dbe2973a82e
Jul 16 17:14:25.231575 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.231546    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"]
Jul 16 17:14:25.234182 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:14:25.234157    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7cc385_b6ae_4198_8da2_41e22d0ca6b3.slice/crio-1a86f392a6e4a70b10f6bedd1fe93fb383a3431f182664680f21bc2e7ff9851d WatchSource:0}: Error finding container 1a86f392a6e4a70b10f6bedd1fe93fb383a3431f182664680f21bc2e7ff9851d: Status 404 returned error can't find the container with id 1a86f392a6e4a70b10f6bedd1fe93fb383a3431f182664680f21bc2e7ff9851d
Jul 16 17:14:25.264880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.264852    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr8gm"]
Jul 16 17:14:25.267797 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:14:25.267774    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a677d7_0578_462c_87dc_85668e7965a0.slice/crio-153612fdc12e30f807b426103f1138004708158161aba9e9072bf1bdede47cb6 WatchSource:0}: Error finding container 153612fdc12e30f807b426103f1138004708158161aba9e9072bf1bdede47cb6: Status 404 returned error can't find the container with id 153612fdc12e30f807b426103f1138004708158161aba9e9072bf1bdede47cb6
Jul 16 17:14:25.497674 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.497639    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.497710    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.497790    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.497796    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.497812    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.497843    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:26.497829051 +0000 UTC m=+37.212345704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:25.497871 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.497857    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:26.497850275 +0000 UTC m=+37.212366927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:25.598472 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:25.598436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:25.598628 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.598560    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:25.598628 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:25.598620    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:26.598599281 +0000 UTC m=+37.313115934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:26.013021 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.012978    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq" event={"ID":"db7cc385-b6ae-4198-8da2-41e22d0ca6b3","Type":"ContainerStarted","Data":"1a86f392a6e4a70b10f6bedd1fe93fb383a3431f182664680f21bc2e7ff9851d"}
Jul 16 17:14:26.015121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.015076    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerStarted","Data":"002e8100b68535dd7a9d880e718f2cd4b06ecc7747c6e899d55201de8afeb2a0"}
Jul 16 17:14:26.016764 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.016666    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr8gm" event={"ID":"16a677d7-0578-462c-87dc-85668e7965a0","Type":"ContainerStarted","Data":"153612fdc12e30f807b426103f1138004708158161aba9e9072bf1bdede47cb6"}
Jul 16 17:14:26.018984 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.018933    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4" event={"ID":"923b862b-ab24-49a5-9e49-8e019c995808","Type":"ContainerStarted","Data":"a702f8a17d1781c20acfd96edfcf439465bd1d6a3ae39125d6878dbe2973a82e"}
Jul 16 17:14:26.506401 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.506360    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:26.506588 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.506446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:26.506588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.506586    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:26.506694 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.506598    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:26.506694 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.506655    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:28.506635749 +0000 UTC m=+39.221152424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:26.507256 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.507206    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:26.507384 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.507291    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:28.507275657 +0000 UTC m=+39.221792323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:26.607087 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:26.607047    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:26.607283 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.607222    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:26.607347 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:26.607290    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:28.607269524 +0000 UTC m=+39.321786183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:28.526054 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:28.526017    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:28.526098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.526210    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.526278    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.526292    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.526284    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:32.526264537 +0000 UTC m=+43.240781193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:28.526588 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.526341    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:32.526326401 +0000 UTC m=+43.240843052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:28.626579 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:28.626551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:28.626732 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.626663    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:28.626732 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:28.626722    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:32.626708832 +0000 UTC m=+43.341225487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:30.284450 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:30.284390    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:30.798760 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:30.798718    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:32.043532 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.043462    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4" event={"ID":"923b862b-ab24-49a5-9e49-8e019c995808","Type":"ContainerStarted","Data":"c3333a937d455f6ca73e1ed1392b2c8d7f615d4ed6415b23e9ccbf8595a39671"}
Jul 16 17:14:32.046243 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.046212    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerStarted","Data":"482884888c6dfdae72cc9c89d4b06298da73b206b66e427384ed298362039e75"}
Jul 16 17:14:32.047714 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.047687    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr8gm" event={"ID":"16a677d7-0578-462c-87dc-85668e7965a0","Type":"ContainerStarted","Data":"d7b7080cf63c22958431d08ca224a38a9585027d83116553f67ba18a36390592"}
Jul 16 17:14:32.064470 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.064429    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4" podStartSLOduration=26.783948686 podStartE2EDuration="33.064416908s" totalImagesPullingTime="6.280468222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:32.063827713 +0000 UTC m=+42.778344386" watchObservedRunningTime="2026-07-16 17:14:32.064416908 +0000 UTC m=+42.778933607"
Jul 16 17:14:32.113349 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.113291    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dr8gm" podStartSLOduration=1.893070077 podStartE2EDuration="8.113274146s" totalImagesPullingTime="6.220204069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:32.112498666 +0000 UTC m=+42.827015341" watchObservedRunningTime="2026-07-16 17:14:32.113274146 +0000 UTC m=+42.827790819"
Jul 16 17:14:32.560005 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.559963    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:32.560230 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.560053    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:32.560230 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.560151    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:32.560230 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.560215    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:32.560230 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.560231    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:32.560415 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.560237    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:40.560220231 +0000 UTC m=+51.274736887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:32.560415 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.560294    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:40.560275643 +0000 UTC m=+51.274792322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:32.661248 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:32.661207    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:32.661399 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.661381    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:32.661491 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:32.661478    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:40.661454803 +0000 UTC m=+51.375971459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:34.058773 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.058698    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="482884888c6dfdae72cc9c89d4b06298da73b206b66e427384ed298362039e75" exitCode=0
Jul 16 17:14:34.059148 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.058767    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"482884888c6dfdae72cc9c89d4b06298da73b206b66e427384ed298362039e75"}
Jul 16 17:14:34.060189 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.060159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq" event={"ID":"db7cc385-b6ae-4198-8da2-41e22d0ca6b3","Type":"ContainerStarted","Data":"3c4c6aa84bdc59adf5933d861bca2e4e69cfc7387a612fce345e77e4812320ed"}
Jul 16 17:14:34.060325 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.060220    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:34.062231 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.062209    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:14:34.062488 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.062464    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerStarted","Data":"03e011b1ef38571795ca6407660a2757819ba5b3581b81f877781b1b2e6945e5"}
Jul 16 17:14:34.062582 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.062498    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerStarted","Data":"fb0c24fe010b59ddd137506591182fae8cb4aca0b50b193f0ce1668b711482c1"}
Jul 16 17:14:34.062582 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.062511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerStarted","Data":"3673504ac6afe03b91785ce1c9d73ccbb708401c4bee17a878ac15a84bf7a7b2"}
Jul 16 17:14:34.117366 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.117309    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" podStartSLOduration=26.827079252 podStartE2EDuration="35.117292744s" totalImagesPullingTime="8.290213492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:34.116618538 +0000 UTC m=+44.831135215" watchObservedRunningTime="2026-07-16 17:14:34.117292744 +0000 UTC m=+44.831809417"
Jul 16 17:14:34.137505 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:34.137457    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq" podStartSLOduration=27.250370956 podStartE2EDuration="35.137443309s" totalImagesPullingTime="7.887072353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:34.136835815 +0000 UTC m=+44.851352489" watchObservedRunningTime="2026-07-16 17:14:34.137443309 +0000 UTC m=+44.851959982"
Jul 16 17:14:36.538620 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:36.538568    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:36.625943 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:36.625906    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:38.094969 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:38.094927    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:38.215395 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:38.215289    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:38.353506 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:38.353432    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log" limit=1024
Jul 16 17:14:39.078351 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:39.078321    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="47d2df1928865ba979363e7d1b7298e81e04dbcae19f8233317bf5d6780ad9e7" exitCode=0
Jul 16 17:14:39.078528 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:39.078374    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"47d2df1928865ba979363e7d1b7298e81e04dbcae19f8233317bf5d6780ad9e7"}
Jul 16 17:14:40.087435 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:40.087403    2555 generic.go:356] "Generic (PLEG): container finished" podID="c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c" containerID="e204f5c1d711a2c16fc8a2897b848f748abc985ae1119730b968a0b58ceda953" exitCode=0
Jul 16 17:14:40.087846 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:40.087473    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerDied","Data":"e204f5c1d711a2c16fc8a2897b848f748abc985ae1119730b968a0b58ceda953"}
Jul 16 17:14:40.627972 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:40.627931    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:40.628149 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:40.627986    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:40.628149 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.628069    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:40.628149 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.628070    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:40.628250 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.628157    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:40.628250 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.628158    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:56.628138824 +0000 UTC m=+67.342655476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:40.628250 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.628208    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:14:56.628195412 +0000 UTC m=+67.342712066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:40.728936 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:40.728900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:40.729072 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.729058    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:40.729156 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:40.729144    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:14:56.729121753 +0000 UTC m=+67.443638422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:14:41.094727 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:41.094698    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" event={"ID":"c9dae03c-89fe-4ea0-a4a6-8fb59c8c234c","Type":"ContainerStarted","Data":"1a0502d535d4e26bd9931b06feb4159244802debefd44edd683fbdb46d3188bd"}
Jul 16 17:14:41.132437 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:41.132388    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mzfvv" podStartSLOduration=9.715649621 podStartE2EDuration="51.132366487s" totalImagesPullingTime="41.416716866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:14:41.128489187 +0000 UTC m=+51.843005872" watchObservedRunningTime="2026-07-16 17:14:41.132366487 +0000 UTC m=+51.846883163"
Jul 16 17:14:49.000676 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:49.000650    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xvjmz"
Jul 16 17:14:55.541733 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.541686    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:55.542261 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.541740    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:14:55.545636 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.545614    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:14:55.545743 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.545665    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:14:55.552100 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:55.552079    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 17:14:55.552211 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:55.552173    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:15:59.552150717 +0000 UTC m=+130.266667369 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : secret "metrics-daemon-secret" not found
Jul 16 17:14:55.555246 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.555226    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0e38676-4590-413a-8a6a-d06077f8aa5d-original-pull-secret\") pod \"global-pull-secret-syncer-p4pp7\" (UID: \"c0e38676-4590-413a-8a6a-d06077f8aa5d\") " pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:55.642836 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.642806    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:55.647612 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.647587    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:14:55.660249 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.660227    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:14:55.665708 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.665690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdvf\" (UniqueName: \"kubernetes.io/projected/e46d077f-170c-4146-afc2-c307d9ebfa0b-kube-api-access-xpdvf\") pod \"network-check-target-5w757\" (UID: \"e46d077f-170c-4146-afc2-c307d9ebfa0b\") " pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:55.750154 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.750127    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p4pp7"
Jul 16 17:14:55.758277 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.758259    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9l5d5\""
Jul 16 17:14:55.766363 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.766341    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:14:55.907703 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.907672    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p4pp7"]
Jul 16 17:14:55.910570 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:14:55.910533    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e38676_4590_413a_8a6a_d06077f8aa5d.slice/crio-bbf5f0f9bc41c86f4343ba4806fe0b3ee63cc5573fad33bd9b21c4f8b387eaa4 WatchSource:0}: Error finding container bbf5f0f9bc41c86f4343ba4806fe0b3ee63cc5573fad33bd9b21c4f8b387eaa4: Status 404 returned error can't find the container with id bbf5f0f9bc41c86f4343ba4806fe0b3ee63cc5573fad33bd9b21c4f8b387eaa4
Jul 16 17:14:55.924896 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:55.924873    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5w757"]
Jul 16 17:14:55.927791 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:14:55.927768    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46d077f_170c_4146_afc2_c307d9ebfa0b.slice/crio-90ebdb60c6b1307b52f5901d54479c6642626ce28e2fd5cdefb86e4ec82236be WatchSource:0}: Error finding container 90ebdb60c6b1307b52f5901d54479c6642626ce28e2fd5cdefb86e4ec82236be: Status 404 returned error can't find the container with id 90ebdb60c6b1307b52f5901d54479c6642626ce28e2fd5cdefb86e4ec82236be
Jul 16 17:14:56.142990 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:56.142920    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p4pp7" event={"ID":"c0e38676-4590-413a-8a6a-d06077f8aa5d","Type":"ContainerStarted","Data":"bbf5f0f9bc41c86f4343ba4806fe0b3ee63cc5573fad33bd9b21c4f8b387eaa4"}
Jul 16 17:14:56.143929 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:56.143903    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5w757" event={"ID":"e46d077f-170c-4146-afc2-c307d9ebfa0b","Type":"ContainerStarted","Data":"90ebdb60c6b1307b52f5901d54479c6642626ce28e2fd5cdefb86e4ec82236be"}
Jul 16 17:14:56.650504 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:56.650470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:56.650522    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.650624    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.650624    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.650689    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:15:28.650673739 +0000 UTC m=+99.365190396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.650635    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:14:56.650876 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.650756    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:15:28.65074392 +0000 UTC m=+99.365260574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:14:56.751184 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:14:56.751152    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:14:56.751308 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.751254    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:14:56.751308 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:14:56.751302    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:15:28.751289683 +0000 UTC m=+99.465806335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:15:04.172820 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:04.172714    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p4pp7" event={"ID":"c0e38676-4590-413a-8a6a-d06077f8aa5d","Type":"ContainerStarted","Data":"73f835e2dd95d60a6835f1ba1e19232f92db820482bc09b17ca0d2989768b56c"}
Jul 16 17:15:04.174250 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:04.174217    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5w757" event={"ID":"e46d077f-170c-4146-afc2-c307d9ebfa0b","Type":"ContainerStarted","Data":"f744232cc19244210843118c2b8d1f64a545b762626ed876835647901abd5844"}
Jul 16 17:15:04.174367 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:04.174356    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:15:04.192782 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:04.192733    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p4pp7" podStartSLOduration=66.1628239 podStartE2EDuration="1m14.192719351s" totalImagesPullingTime="8.029895451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:15:04.19185671 +0000 UTC m=+74.906373385" watchObservedRunningTime="2026-07-16 17:15:04.192719351 +0000 UTC m=+74.907236016"
Jul 16 17:15:04.211439 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:04.211395    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5w757" podStartSLOduration=66.211800754 podStartE2EDuration="1m14.211379672s" totalImagesPullingTime="7.999578918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:15:04.211128934 +0000 UTC m=+74.925645613" watchObservedRunningTime="2026-07-16 17:15:04.211379672 +0000 UTC m=+74.925896345"
Jul 16 17:15:28.686957 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:28.686925    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:28.686972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.687080    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.687164    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert podName:63cebda9-6aed-479d-888c-e85cec991785 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:32.687148037 +0000 UTC m=+163.401664688 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tnwtv" (UID: "63cebda9-6aed-479d-888c-e85cec991785") : secret "networking-console-plugin-cert" not found
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.687085    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.687187    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cbc597567-z6z9m: secret "image-registry-tls" not found
Jul 16 17:15:28.687296 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.687227    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls podName:94e7c94c-5c78-4045-afd0-09f25d75e069 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:32.687215094 +0000 UTC m=+163.401731746 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls") pod "image-registry-5cbc597567-z6z9m" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069") : secret "image-registry-tls" not found
Jul 16 17:15:28.787786 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:28.787755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:15:28.787919 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.787869    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:15:28.787985 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:28.787924    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls podName:d034936d-7f0d-40b5-a4d9-4b43f6222d3c nodeName:}" failed. No retries permitted until 2026-07-16 17:16:32.787908517 +0000 UTC m=+163.502425176 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls") pod "dns-default-5dwz7" (UID: "d034936d-7f0d-40b5-a4d9-4b43f6222d3c") : secret "dns-default-metrics-tls" not found
Jul 16 17:15:35.179390 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:35.179363    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5w757"
Jul 16 17:15:59.600652 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:15:59.600616    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:15:59.601232 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:59.600793    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 17:15:59.601232 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:15:59.600907    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs podName:22f4c910-cda0-4863-a64c-00d226b80419 nodeName:}" failed. No retries permitted until 2026-07-16 17:18:01.600885971 +0000 UTC m=+252.315402630 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs") pod "network-metrics-daemon-zqljw" (UID: "22f4c910-cda0-4863-a64c-00d226b80419") : secret "metrics-daemon-secret" not found
Jul 16 17:16:05.808501 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.808468    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dfl4p"]
Jul 16 17:16:05.810803 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.810786    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.813608 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.813582    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 17:16:05.813608 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.813598    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 17:16:05.813761 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.813672    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t9pcw\""
Jul 16 17:16:05.814627 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.814607    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 17:16:05.814725 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.814655    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 17:16:05.831784 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.831765    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfl4p"]
Jul 16 17:16:05.848613 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.848594    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-crio-socket\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.848696 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.848641    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-data-volume\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.848696 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.848681    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.848797 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.848726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ftk\" (UniqueName: \"kubernetes.io/projected/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-api-access-b7ftk\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.848850 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.848828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.949206 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.949182    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-crio-socket\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.949328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.949232    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-data-volume\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.949328 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.949258    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.949787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.949315    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-crio-socket\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.949921 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.949476    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ftk\" (UniqueName: \"kubernetes.io/projected/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-api-access-b7ftk\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.953763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.953738    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.953861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.953763    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-data-volume\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:05.953861 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:05.953744    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:05.953861 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:05.953844    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:16:05.954005 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:05.953884    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:06.453860038 +0000 UTC m=+137.168376707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:05.954005 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:05.953935    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:06.453891456 +0000 UTC m=+137.168408134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : configmap "kube-rbac-proxy" not found
Jul 16 17:16:05.965736 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:05.965720    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ftk\" (UniqueName: \"kubernetes.io/projected/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-api-access-b7ftk\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:06.457311 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:06.457281    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:06.457470 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:06.457336    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:06.457470 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:06.457410    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:16:06.457470 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:06.457421    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:06.457574 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:06.457474    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:07.457462096 +0000 UTC m=+138.171978747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:06.457574 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:06.457487    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:07.457480865 +0000 UTC m=+138.171997517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : configmap "kube-rbac-proxy" not found
Jul 16 17:16:07.465561 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:07.465532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:07.465908 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:07.465587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:07.465908 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:07.465656    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:16:07.465908 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:07.465671    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:07.465908 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:07.465721    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:09.465706843 +0000 UTC m=+140.180223495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:07.465908 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:07.465788    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:09.465771633 +0000 UTC m=+140.180288288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : configmap "kube-rbac-proxy" not found
Jul 16 17:16:07.761563 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:07.761494    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw9wb_68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7/dns-node-resolver/0.log"
Jul 16 17:16:08.363479 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:08.363454    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cmsm5_0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9/node-ca/0.log"
Jul 16 17:16:09.162920 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:09.162892    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dr8gm_16a677d7-0578-462c-87dc-85668e7965a0/serve-healthcheck-canary/0.log"
Jul 16 17:16:09.483238 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:09.483208    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:09.483419 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:09.483265    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:09.483419 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:09.483356    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:16:09.483419 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:09.483380    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:09.483583 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:09.483431    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:13.483409451 +0000 UTC m=+144.197926109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : configmap "kube-rbac-proxy" not found
Jul 16 17:16:09.483583 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:09.483451    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:13.483441665 +0000 UTC m=+144.197958317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:13.511516 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:13.511487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:13.511904 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:13.511541    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:13.511904 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:13.511605    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:16:13.511904 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:13.511620    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:13.511904 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:13.511659    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:21.511644117 +0000 UTC m=+152.226160773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : configmap "kube-rbac-proxy" not found
Jul 16 17:16:13.511904 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:13.511714    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:21.51170689 +0000 UTC m=+152.226223542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:21.571230 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:21.571192    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:21.571622 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:21.571261    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:21.571622 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:21.571384    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:21.571622 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:21.571451    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls podName:65ebeec5-b68e-4f83-b7d3-e8f2244a0982 nodeName:}" failed. No retries permitted until 2026-07-16 17:16:37.571436165 +0000 UTC m=+168.285952817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfl4p" (UID: "65ebeec5-b68e-4f83-b7d3-e8f2244a0982") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:16:21.571728 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:21.571689    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:27.717398 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:27.717358    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069"
Jul 16 17:16:27.767673 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:27.767641    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv" podUID="63cebda9-6aed-479d-888c-e85cec991785"
Jul 16 17:16:27.822905 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:27.822873    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5dwz7" podUID="d034936d-7f0d-40b5-a4d9-4b43f6222d3c"
Jul 16 17:16:27.860752 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:16:27.860729    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zqljw" podUID="22f4c910-cda0-4863-a64c-00d226b80419"
Jul 16 17:16:28.415164 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:28.415137    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:28.415323 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:28.415141    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:16:28.415323 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:28.415141    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:32.429019 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.428981    2555 generic.go:356] "Generic (PLEG): container finished" podID="923b862b-ab24-49a5-9e49-8e019c995808" containerID="c3333a937d455f6ca73e1ed1392b2c8d7f615d4ed6415b23e9ccbf8595a39671" exitCode=255
Jul 16 17:16:32.429464 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.429062    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4" event={"ID":"923b862b-ab24-49a5-9e49-8e019c995808","Type":"ContainerDied","Data":"c3333a937d455f6ca73e1ed1392b2c8d7f615d4ed6415b23e9ccbf8595a39671"}
Jul 16 17:16:32.429464 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.429418    2555 scope.go:117] "RemoveContainer" containerID="c3333a937d455f6ca73e1ed1392b2c8d7f615d4ed6415b23e9ccbf8595a39671"
Jul 16 17:16:32.755763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.755723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:32.755919 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.755862    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:16:32.758230 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.758198    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"image-registry-5cbc597567-z6z9m\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") " pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:32.758370 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.758350    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63cebda9-6aed-479d-888c-e85cec991785-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tnwtv\" (UID: \"63cebda9-6aed-479d-888c-e85cec991785\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:16:32.856991 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.856963    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:32.859264 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.859248    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d034936d-7f0d-40b5-a4d9-4b43f6222d3c-metrics-tls\") pod \"dns-default-5dwz7\" (UID: \"d034936d-7f0d-40b5-a4d9-4b43f6222d3c\") " pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:32.919698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.919676    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gtbr4\""
Jul 16 17:16:32.920536 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.920524    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bfmt5\""
Jul 16 17:16:32.920621 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.920606    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bqh7f\""
Jul 16 17:16:32.926787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.926771    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"
Jul 16 17:16:32.926832 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.926795    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:32.926865 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:32.926859    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:33.079217 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.079186    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tnwtv"]
Jul 16 17:16:33.082083 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:16:33.082062    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cebda9_6aed_479d_888c_e85cec991785.slice/crio-69850238ad34aa26d12758954df66fe6e004da623b6e5656fd25f6aa77ec4aa9 WatchSource:0}: Error finding container 69850238ad34aa26d12758954df66fe6e004da623b6e5656fd25f6aa77ec4aa9: Status 404 returned error can't find the container with id 69850238ad34aa26d12758954df66fe6e004da623b6e5656fd25f6aa77ec4aa9
Jul 16 17:16:33.106562 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.106540    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:16:33.108862 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.108840    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5dwz7"]
Jul 16 17:16:33.109472 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:16:33.109450    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e7c94c_5c78_4045_afd0_09f25d75e069.slice/crio-64660f2a68d5d70109e9bad545ce5c41bae0aca3148ee86381cbefe0be278ca9 WatchSource:0}: Error finding container 64660f2a68d5d70109e9bad545ce5c41bae0aca3148ee86381cbefe0be278ca9: Status 404 returned error can't find the container with id 64660f2a68d5d70109e9bad545ce5c41bae0aca3148ee86381cbefe0be278ca9
Jul 16 17:16:33.112535 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:16:33.112514    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd034936d_7f0d_40b5_a4d9_4b43f6222d3c.slice/crio-04289d76b39011d61084e65dbb1090f8c7011a618143c39c3bddaa4d8a2b8adb WatchSource:0}: Error finding container 04289d76b39011d61084e65dbb1090f8c7011a618143c39c3bddaa4d8a2b8adb: Status 404 returned error can't find the container with id 04289d76b39011d61084e65dbb1090f8c7011a618143c39c3bddaa4d8a2b8adb
Jul 16 17:16:33.434297 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.434220    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5fb5474-llbz4" event={"ID":"923b862b-ab24-49a5-9e49-8e019c995808","Type":"ContainerStarted","Data":"f40da3eed66e9a7c0a536dc7c3dd392a47d57b771f8827ce5deb55660dc677ef"}
Jul 16 17:16:33.435838 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.435810    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv" event={"ID":"63cebda9-6aed-479d-888c-e85cec991785","Type":"ContainerStarted","Data":"69850238ad34aa26d12758954df66fe6e004da623b6e5656fd25f6aa77ec4aa9"}
Jul 16 17:16:33.437286 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.437262    2555 generic.go:356] "Generic (PLEG): container finished" podID="db7cc385-b6ae-4198-8da2-41e22d0ca6b3" containerID="3c4c6aa84bdc59adf5933d861bca2e4e69cfc7387a612fce345e77e4812320ed" exitCode=1
Jul 16 17:16:33.437399 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.437327    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq" event={"ID":"db7cc385-b6ae-4198-8da2-41e22d0ca6b3","Type":"ContainerDied","Data":"3c4c6aa84bdc59adf5933d861bca2e4e69cfc7387a612fce345e77e4812320ed"}
Jul 16 17:16:33.437644 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.437627    2555 scope.go:117] "RemoveContainer" containerID="3c4c6aa84bdc59adf5933d861bca2e4e69cfc7387a612fce345e77e4812320ed"
Jul 16 17:16:33.438566 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.438541    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dwz7" event={"ID":"d034936d-7f0d-40b5-a4d9-4b43f6222d3c","Type":"ContainerStarted","Data":"04289d76b39011d61084e65dbb1090f8c7011a618143c39c3bddaa4d8a2b8adb"}
Jul 16 17:16:33.440249 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.440176    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" event={"ID":"94e7c94c-5c78-4045-afd0-09f25d75e069","Type":"ContainerStarted","Data":"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"}
Jul 16 17:16:33.440249 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.440221    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" event={"ID":"94e7c94c-5c78-4045-afd0-09f25d75e069","Type":"ContainerStarted","Data":"64660f2a68d5d70109e9bad545ce5c41bae0aca3148ee86381cbefe0be278ca9"}
Jul 16 17:16:33.440362 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.440328    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:33.512695 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:33.512642    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" podStartSLOduration=163.512627237 podStartE2EDuration="2m43.512627237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:16:33.489632398 +0000 UTC m=+164.204149072" watchObservedRunningTime="2026-07-16 17:16:33.512627237 +0000 UTC m=+164.227143911"
Jul 16 17:16:34.061378 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:34.061286    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:16:34.445655 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:34.445622    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq" event={"ID":"db7cc385-b6ae-4198-8da2-41e22d0ca6b3","Type":"ContainerStarted","Data":"f4d37eb6a2396a6c94d6f7ac112ba3f3b447992fee1574c0763008fa5974690e"}
Jul 16 17:16:34.446082 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:34.445777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:16:34.446526 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:34.446506    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65b6555dd8-9chpq"
Jul 16 17:16:34.447491 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:34.447467    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv" event={"ID":"63cebda9-6aed-479d-888c-e85cec991785","Type":"ContainerStarted","Data":"35212bd738815269edba1c7dc9a1b44695dae530d711c0c843d197c2174b3694"}
Jul 16 17:16:35.452229 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:35.452195    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dwz7" event={"ID":"d034936d-7f0d-40b5-a4d9-4b43f6222d3c","Type":"ContainerStarted","Data":"99efeaa5ff91143aacb3758c39d103db416e3586a8cb8e9dc044f36c141e734d"}
Jul 16 17:16:35.452625 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:35.452255    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5dwz7" event={"ID":"d034936d-7f0d-40b5-a4d9-4b43f6222d3c","Type":"ContainerStarted","Data":"b41b2ba7d6cab0bf1b360b3379cd0da47df6ab590c4978d19777dc5096f937f3"}
Jul 16 17:16:35.475536 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:35.475492    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-tnwtv" podStartSLOduration=154.25477728 podStartE2EDuration="2m35.475477875s" totalImagesPullingTime="1.220700595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:16:34.518905032 +0000 UTC m=+165.233421706" watchObservedRunningTime="2026-07-16 17:16:35.475477875 +0000 UTC m=+166.189994548"
Jul 16 17:16:35.475684 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:35.475628    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5dwz7" podStartSLOduration=129.758699762 podStartE2EDuration="2m11.475616765s" totalImagesPullingTime="1.716917003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:16:35.474326454 +0000 UTC m=+166.188843130" watchObservedRunningTime="2026-07-16 17:16:35.475616765 +0000 UTC m=+166.190133440"
Jul 16 17:16:36.455469 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:36.455438    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:37.593094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:37.593057    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:37.595438 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:37.595416    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ebeec5-b68e-4f83-b7d3-e8f2244a0982-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfl4p\" (UID: \"65ebeec5-b68e-4f83-b7d3-e8f2244a0982\") " pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:37.620373 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:37.620351    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfl4p"
Jul 16 17:16:37.748171 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:37.748141    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfl4p"]
Jul 16 17:16:37.751038 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:16:37.751015    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ebeec5_b68e_4f83_b7d3_e8f2244a0982.slice/crio-8a0596afe09af8458acf6ce6b36a6c54880000479aa0b2a3764672f6f0e60a83 WatchSource:0}: Error finding container 8a0596afe09af8458acf6ce6b36a6c54880000479aa0b2a3764672f6f0e60a83: Status 404 returned error can't find the container with id 8a0596afe09af8458acf6ce6b36a6c54880000479aa0b2a3764672f6f0e60a83
Jul 16 17:16:38.464294 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:38.464249    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfl4p" event={"ID":"65ebeec5-b68e-4f83-b7d3-e8f2244a0982","Type":"ContainerStarted","Data":"8a0596afe09af8458acf6ce6b36a6c54880000479aa0b2a3764672f6f0e60a83"}
Jul 16 17:16:41.839375 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:41.839299    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:16:43.484301 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:43.484257    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfl4p" event={"ID":"65ebeec5-b68e-4f83-b7d3-e8f2244a0982","Type":"ContainerStarted","Data":"a6184c8a9ccf4e96dc3c0b8d9902e412ab42c5e318952f87047484f34c5a816b"}
Jul 16 17:16:45.036987 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:45.036946    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" podUID="1718a1dc-41c3-41b8-a6e7-69e7ca375bc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 17:16:46.460575 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:46.460541    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5dwz7"
Jul 16 17:16:48.503051 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:48.503017    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfl4p" event={"ID":"65ebeec5-b68e-4f83-b7d3-e8f2244a0982","Type":"ContainerStarted","Data":"2b3517e62ad7df48dc4077f3251507781d6890eac3f140f178cc144fe1e87bfb"}
Jul 16 17:16:52.519520 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:52.519481    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfl4p" event={"ID":"65ebeec5-b68e-4f83-b7d3-e8f2244a0982","Type":"ContainerStarted","Data":"3284d09c565acda8a8f35fd6c481fa993595a113376e82ba4cfac705d811baae"}
Jul 16 17:16:52.587348 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:52.587292    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dfl4p" podStartSLOduration=33.950376059 podStartE2EDuration="47.587275717s" totalImagesPullingTime="13.636899658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:16:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:16:52.586237638 +0000 UTC m=+183.300754314" watchObservedRunningTime="2026-07-16 17:16:52.587275717 +0000 UTC m=+183.301792391"
Jul 16 17:16:52.931698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:52.931615    2555 patch_prober.go:28] interesting pod/image-registry-5cbc597567-z6z9m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 17:16:52.931698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:52.931669    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 17:16:53.000825 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.000795    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cwh9g"]
Jul 16 17:16:53.003115 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.003088    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.007258 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.007239    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 17:16:53.011896 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.011878    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 17:16:53.012215 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.012196    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 17:16:53.016386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.016359    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 17:16:53.016482 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.016392    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b285m\""
Jul 16 17:16:53.016482 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.016426    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 17:16:53.026099 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.026082    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 17:16:53.115345 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115323    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-metrics-client-ca\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-sys\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115379    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115432    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-tls\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115591 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qhl\" (UniqueName: \"kubernetes.io/projected/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-kube-api-access-67qhl\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115591 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115524    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-textfile\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115591 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115563    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-wtmp\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115591 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115585    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.115719 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.115602    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-root\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216352 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216323    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216459 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216358    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-tls\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216459 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qhl\" (UniqueName: \"kubernetes.io/projected/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-kube-api-access-67qhl\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216459 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-textfile\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216630 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-wtmp\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216630 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216630 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216517    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-root\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216630 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-metrics-client-ca\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216630 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-sys\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216630    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-wtmp\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216660    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-sys\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216686    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-root\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.216861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.216819    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-textfile\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.217029 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.217004    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.217159 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.217143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-metrics-client-ca\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.218830 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.218812    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-tls\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.218909 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.218870    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.228572 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.228551    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qhl\" (UniqueName: \"kubernetes.io/projected/65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a-kube-api-access-67qhl\") pod \"node-exporter-cwh9g\" (UID: \"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a\") " pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.311677 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.311655    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwh9g"
Jul 16 17:16:53.322293 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:16:53.322268    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b8ee3e_6952_4c61_8ea3_4ae84c6dfd6a.slice/crio-1224e5b4e00e445ef1ac5e26c751bb6a815977231777d2c91c647587548b1c5a WatchSource:0}: Error finding container 1224e5b4e00e445ef1ac5e26c751bb6a815977231777d2c91c647587548b1c5a: Status 404 returned error can't find the container with id 1224e5b4e00e445ef1ac5e26c751bb6a815977231777d2c91c647587548b1c5a
Jul 16 17:16:53.523292 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:53.523198    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwh9g" event={"ID":"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a","Type":"ContainerStarted","Data":"1224e5b4e00e445ef1ac5e26c751bb6a815977231777d2c91c647587548b1c5a"}
Jul 16 17:16:54.452472 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:54.452443    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:16:55.037443 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:55.037407    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" podUID="1718a1dc-41c3-41b8-a6e7-69e7ca375bc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 17:16:57.541416 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:57.541376    2555 generic.go:356] "Generic (PLEG): container finished" podID="65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a" containerID="4265ae14f9ccdc265a3eaef87a7512b9780d90fce40bd1a8a0a094d2558deafb" exitCode=0
Jul 16 17:16:57.541833 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:57.541464    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwh9g" event={"ID":"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a","Type":"ContainerDied","Data":"4265ae14f9ccdc265a3eaef87a7512b9780d90fce40bd1a8a0a094d2558deafb"}
Jul 16 17:16:58.547695 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:58.547662    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwh9g" event={"ID":"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a","Type":"ContainerStarted","Data":"65a52d5cf678af4aa4b427753228f77077d2d50e695e45c8e7a5ba1663a1f4fe"}
Jul 16 17:16:58.548070 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:58.547718    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwh9g" event={"ID":"65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a","Type":"ContainerStarted","Data":"3ba5bbf81b974750b924fa0271c17bdf1e05bc52dc9d55b4bd4ec18d17827b6a"}
Jul 16 17:16:58.577250 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:16:58.577205    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cwh9g" podStartSLOduration=3.327587164 podStartE2EDuration="6.577188759s" totalImagesPullingTime="3.177565639s" totalInitContainerRuntime="72.035956ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:16:58.575559152 +0000 UTC m=+189.290075827" watchObservedRunningTime="2026-07-16 17:16:58.577188759 +0000 UTC m=+189.291705433"
Jul 16 17:17:05.037175 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.037132    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" podUID="1718a1dc-41c3-41b8-a6e7-69e7ca375bc9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 17:17:05.037610 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.037207    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t"
Jul 16 17:17:05.037787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.037753    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"03e011b1ef38571795ca6407660a2757819ba5b3581b81f877781b1b2e6945e5"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 16 17:17:05.037825 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.037811    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" podUID="1718a1dc-41c3-41b8-a6e7-69e7ca375bc9" containerName="service-proxy" containerID="cri-o://03e011b1ef38571795ca6407660a2757819ba5b3581b81f877781b1b2e6945e5" gracePeriod=30
Jul 16 17:17:05.571711 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.571677    2555 generic.go:356] "Generic (PLEG): container finished" podID="1718a1dc-41c3-41b8-a6e7-69e7ca375bc9" containerID="03e011b1ef38571795ca6407660a2757819ba5b3581b81f877781b1b2e6945e5" exitCode=2
Jul 16 17:17:05.571711 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.571721    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerDied","Data":"03e011b1ef38571795ca6407660a2757819ba5b3581b81f877781b1b2e6945e5"}
Jul 16 17:17:05.571912 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.571753    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4ff7746b-lgm8t" event={"ID":"1718a1dc-41c3-41b8-a6e7-69e7ca375bc9","Type":"ContainerStarted","Data":"4c2e3f0b0d01f0d4340ab0dd30b74270636df5fe458706334d3bc1bb6b9d1763"}
Jul 16 17:17:05.848770 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:05.848698    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:17:30.869273 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:30.869210    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerName="registry" containerID="cri-o://5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9" gracePeriod=30
Jul 16 17:17:31.112034 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.112012    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:17:31.177391 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177314    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177391 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177347    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177391 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177371    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177406    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177438    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177473    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v9kv\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177498    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177844 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177819    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:17:31.177900 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177525    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted\") pod \"94e7c94c-5c78-4045-afd0-09f25d75e069\" (UID: \"94e7c94c-5c78-4045-afd0-09f25d75e069\") "
Jul 16 17:17:31.177950 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.177916    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:17:31.178126 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.178093    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-certificates\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.178180 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.178137    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94e7c94c-5c78-4045-afd0-09f25d75e069-trusted-ca\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.180197 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.180151    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:17:31.180318 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.180276    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv" (OuterVolumeSpecName: "kube-api-access-7v9kv") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "kube-api-access-7v9kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:17:31.180318 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.180300    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:17:31.180410 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.180320    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:17:31.180410 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.180331    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:17:31.185949 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.185927    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "94e7c94c-5c78-4045-afd0-09f25d75e069" (UID: "94e7c94c-5c78-4045-afd0-09f25d75e069"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:17:31.278778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278733    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-registry-tls\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.278778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278773    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-image-registry-private-configuration\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.278778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278785    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-bound-sa-token\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.278778 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278793    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v9kv\" (UniqueName: \"kubernetes.io/projected/94e7c94c-5c78-4045-afd0-09f25d75e069-kube-api-access-7v9kv\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.279019 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278803    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94e7c94c-5c78-4045-afd0-09f25d75e069-installation-pull-secrets\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.279019 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.278813    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94e7c94c-5c78-4045-afd0-09f25d75e069-ca-trust-extracted\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:17:31.658150 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.658120    2555 generic.go:356] "Generic (PLEG): container finished" podID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerID="5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9" exitCode=0
Jul 16 17:17:31.658321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.658162    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m"
Jul 16 17:17:31.658321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.658180    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" event={"ID":"94e7c94c-5c78-4045-afd0-09f25d75e069","Type":"ContainerDied","Data":"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"}
Jul 16 17:17:31.658321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.658222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cbc597567-z6z9m" event={"ID":"94e7c94c-5c78-4045-afd0-09f25d75e069","Type":"ContainerDied","Data":"64660f2a68d5d70109e9bad545ce5c41bae0aca3148ee86381cbefe0be278ca9"}
Jul 16 17:17:31.658321 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.658242    2555 scope.go:117] "RemoveContainer" containerID="5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"
Jul 16 17:17:31.666907 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.666892    2555 scope.go:117] "RemoveContainer" containerID="5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"
Jul 16 17:17:31.667187 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:17:31.667161    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9\": container with ID starting with 5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9 not found: ID does not exist" containerID="5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"
Jul 16 17:17:31.667279 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.667197    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9"} err="failed to get container status \"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9\": rpc error: code = NotFound desc = could not find container \"5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9\": container with ID starting with 5bd3e8832567d535046904d3eee7fd5a80d6244cb9530e030b4736409ca952c9 not found: ID does not exist"
Jul 16 17:17:31.685489 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.685468    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:17:31.690945 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.690438    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cbc597567-z6z9m"]
Jul 16 17:17:31.843242 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:17:31.843210    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" path="/var/lib/kubelet/pods/94e7c94c-5c78-4045-afd0-09f25d75e069/volumes"
Jul 16 17:18:01.682460 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:01.682427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:18:01.684831 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:01.684809    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f4c910-cda0-4863-a64c-00d226b80419-metrics-certs\") pod \"network-metrics-daemon-zqljw\" (UID: \"22f4c910-cda0-4863-a64c-00d226b80419\") " pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:18:01.942936 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:01.942865    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65bh8\""
Jul 16 17:18:01.950202 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:01.950187    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqljw"
Jul 16 17:18:02.099263 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:02.099239    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqljw"]
Jul 16 17:18:02.101264 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:18:02.101233    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f4c910_cda0_4863_a64c_00d226b80419.slice/crio-d3a4c8b5ae49c787983c11acabf0c4b3c23e25ec1fef90884068c0b28ff906fa WatchSource:0}: Error finding container d3a4c8b5ae49c787983c11acabf0c4b3c23e25ec1fef90884068c0b28ff906fa: Status 404 returned error can't find the container with id d3a4c8b5ae49c787983c11acabf0c4b3c23e25ec1fef90884068c0b28ff906fa
Jul 16 17:18:02.759366 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:02.759324    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqljw" event={"ID":"22f4c910-cda0-4863-a64c-00d226b80419","Type":"ContainerStarted","Data":"d3a4c8b5ae49c787983c11acabf0c4b3c23e25ec1fef90884068c0b28ff906fa"}
Jul 16 17:18:03.764404 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:03.764374    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqljw" event={"ID":"22f4c910-cda0-4863-a64c-00d226b80419","Type":"ContainerStarted","Data":"5e1c591adbe5028a9bee3dbe5a6e9756e10a5409c2eff3149c4b966ceb256eee"}
Jul 16 17:18:03.764780 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:03.764426    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqljw" event={"ID":"22f4c910-cda0-4863-a64c-00d226b80419","Type":"ContainerStarted","Data":"f4e5292a9a1032a72898196e9be5870a47d85f465adcb8ba033faa3c6d696e4b"}
Jul 16 17:18:03.791067 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:03.791023    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zqljw" podStartSLOduration=252.811611518 podStartE2EDuration="4m13.791007806s" totalImagesPullingTime="979.396288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:18:03.790237444 +0000 UTC m=+254.504754140" watchObservedRunningTime="2026-07-16 17:18:03.791007806 +0000 UTC m=+254.505524479"
Jul 16 17:18:49.705966 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:49.705941    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:18:49.711148 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:49.711130    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 17:18:49.712061 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:18:49.712043    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:21:26.831669 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.831595    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-d4whs"]
Jul 16 17:21:26.832193 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.831863    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerName="registry"
Jul 16 17:21:26.832277 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.832215    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerName="registry"
Jul 16 17:21:26.836329 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.836305    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="94e7c94c-5c78-4045-afd0-09f25d75e069" containerName="registry"
Jul 16 17:21:26.839169 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.839153    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:26.842836 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.842813    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 16 17:21:26.842934 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.842819    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 16 17:21:26.843736 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.843717    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-78645\""
Jul 16 17:21:26.843835 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.843754    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 16 17:21:26.843835 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.843814    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 16 17:21:26.843971 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.843953    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 16 17:21:26.851382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.851363    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-d4whs"]
Jul 16 17:21:26.929358 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.929333    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4lx\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-kube-api-access-9x4lx\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:26.929456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.929361    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:26.929456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:26.929386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/868a5e3c-d093-4596-9f29-80988a88a4c1-cabundle0\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.030783 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.030753    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/868a5e3c-d093-4596-9f29-80988a88a4c1-cabundle0\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.030951 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.030812    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4lx\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-kube-api-access-9x4lx\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.030951 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.030931    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.031074 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.031032    2555 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 16 17:21:27.031074 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.031051    2555 secret.go:281] references non-existent secret key: ca.crt
Jul 16 17:21:27.031074 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.031061    2555 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 16 17:21:27.031270 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.031076    2555 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-d4whs: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 16 17:21:27.031270 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.031168    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates podName:868a5e3c-d093-4596-9f29-80988a88a4c1 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:27.531146955 +0000 UTC m=+458.245663609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates") pod "keda-operator-77f648d694-d4whs" (UID: "868a5e3c-d093-4596-9f29-80988a88a4c1") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 16 17:21:27.031535 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.031512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/868a5e3c-d093-4596-9f29-80988a88a4c1-cabundle0\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.043474 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.043452    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4lx\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-kube-api-access-9x4lx\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.055571 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.055545    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"]
Jul 16 17:21:27.058531 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.058516    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.060633 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.060614    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 16 17:21:27.069825 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.069805    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"]
Jul 16 17:21:27.232202 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.232178    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4320b701-6b64-496f-91e1-c624cc19cee5-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.232330 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.232208    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.232330 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.232240    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbrdl\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-kube-api-access-pbrdl\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.333513 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.333475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbrdl\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-kube-api-access-pbrdl\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.333646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.333563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4320b701-6b64-496f-91e1-c624cc19cee5-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.333646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.333590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.333819 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.333693    2555 secret.go:281] references non-existent secret key: tls.crt
Jul 16 17:21:27.333819 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.333709    2555 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 16 17:21:27.333819 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.333736    2555 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-4htwm: references non-existent secret key: tls.crt
Jul 16 17:21:27.333819 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:21:27.333819    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates podName:4320b701-6b64-496f-91e1-c624cc19cee5 nodeName:}" failed. No retries permitted until 2026-07-16 17:21:27.833800013 +0000 UTC m=+458.548316683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates") pod "keda-metrics-apiserver-55557df8c-4htwm" (UID: "4320b701-6b64-496f-91e1-c624cc19cee5") : references non-existent secret key: tls.crt
Jul 16 17:21:27.334014 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.333888    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4320b701-6b64-496f-91e1-c624cc19cee5-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.345095 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.345066    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbrdl\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-kube-api-access-pbrdl\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.534839 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.534760    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.537172 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.537151    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/868a5e3c-d093-4596-9f29-80988a88a4c1-certificates\") pod \"keda-operator-77f648d694-d4whs\" (UID: \"868a5e3c-d093-4596-9f29-80988a88a4c1\") " pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.748271 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.748245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:27.837742 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.837705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.840717 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.840685    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4320b701-6b64-496f-91e1-c624cc19cee5-certificates\") pod \"keda-metrics-apiserver-55557df8c-4htwm\" (UID: \"4320b701-6b64-496f-91e1-c624cc19cee5\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:27.881817 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.881797    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-d4whs"]
Jul 16 17:21:27.884306 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:21:27.884284    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868a5e3c_d093_4596_9f29_80988a88a4c1.slice/crio-329463925aa379136a2f428f2d1280604f509ad4b6ab75805d8ee9f7a64aab5c WatchSource:0}: Error finding container 329463925aa379136a2f428f2d1280604f509ad4b6ab75805d8ee9f7a64aab5c: Status 404 returned error can't find the container with id 329463925aa379136a2f428f2d1280604f509ad4b6ab75805d8ee9f7a64aab5c
Jul 16 17:21:27.885691 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.885674    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:21:27.968428 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:27.968401    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:28.099719 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:28.099658    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"]
Jul 16 17:21:28.101946 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:21:28.101921    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4320b701_6b64_496f_91e1_c624cc19cee5.slice/crio-d0d0ab1e389b703e422a186ed675e330bfc18a87370631717f4f6c37f211953c WatchSource:0}: Error finding container d0d0ab1e389b703e422a186ed675e330bfc18a87370631717f4f6c37f211953c: Status 404 returned error can't find the container with id d0d0ab1e389b703e422a186ed675e330bfc18a87370631717f4f6c37f211953c
Jul 16 17:21:28.423142 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:28.423030    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm" event={"ID":"4320b701-6b64-496f-91e1-c624cc19cee5","Type":"ContainerStarted","Data":"d0d0ab1e389b703e422a186ed675e330bfc18a87370631717f4f6c37f211953c"}
Jul 16 17:21:28.424078 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:28.424052    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-d4whs" event={"ID":"868a5e3c-d093-4596-9f29-80988a88a4c1","Type":"ContainerStarted","Data":"329463925aa379136a2f428f2d1280604f509ad4b6ab75805d8ee9f7a64aab5c"}
Jul 16 17:21:32.441141 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.441083    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm" event={"ID":"4320b701-6b64-496f-91e1-c624cc19cee5","Type":"ContainerStarted","Data":"b1ed44dc9944ee5b34f7e05d0dbe3832c1a1b0caa5454530ba5f2eeab9cd8d24"}
Jul 16 17:21:32.441559 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.441173    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:32.442544 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.442522    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-d4whs" event={"ID":"868a5e3c-d093-4596-9f29-80988a88a4c1","Type":"ContainerStarted","Data":"4e759859a2168076c9e36ee3eafd0e42e8ce99b8624c55b199bece5723e8c91d"}
Jul 16 17:21:32.442686 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.442668    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:21:32.467237 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.467195    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm" podStartSLOduration=1.281423944 podStartE2EDuration="5.467182527s" totalImagesPullingTime="4.185758583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:32.46595943 +0000 UTC m=+463.180476104" watchObservedRunningTime="2026-07-16 17:21:32.467182527 +0000 UTC m=+463.181699241"
Jul 16 17:21:32.488390 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:32.488353    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-d4whs" podStartSLOduration=2.085440416 podStartE2EDuration="6.488329532s" totalImagesPullingTime="4.402889116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:21:32.487617543 +0000 UTC m=+463.202134411" watchObservedRunningTime="2026-07-16 17:21:32.488329532 +0000 UTC m=+463.202846206"
Jul 16 17:21:43.450089 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:43.450061    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-4htwm"
Jul 16 17:21:53.448470 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:21:53.448442    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-d4whs"
Jul 16 17:22:36.685759 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.685727    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-bqk2x"]
Jul 16 17:22:36.687884 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.687868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.690486 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.690466    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 16 17:22:36.690621 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.690493    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 16 17:22:36.691541 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.691524    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 16 17:22:36.691593 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.691524    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-s2gw8\""
Jul 16 17:22:36.702728 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.702704    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bqk2x"]
Jul 16 17:22:36.793373 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.793350    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425kj\" (UniqueName: \"kubernetes.io/projected/9cd031a3-9511-40ae-b54d-3e174e6fb546-kube-api-access-425kj\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.793490 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.793391    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cd031a3-9511-40ae-b54d-3e174e6fb546-data\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.894380 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.894343    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425kj\" (UniqueName: \"kubernetes.io/projected/9cd031a3-9511-40ae-b54d-3e174e6fb546-kube-api-access-425kj\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.894536 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.894392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cd031a3-9511-40ae-b54d-3e174e6fb546-data\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.894764 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.894747    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9cd031a3-9511-40ae-b54d-3e174e6fb546-data\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.905774 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.905754    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425kj\" (UniqueName: \"kubernetes.io/projected/9cd031a3-9511-40ae-b54d-3e174e6fb546-kube-api-access-425kj\") pod \"seaweedfs-64568bcd49-bqk2x\" (UID: \"9cd031a3-9511-40ae-b54d-3e174e6fb546\") " pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:36.996346 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:36.996323    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:37.126281 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:37.126259    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bqk2x"]
Jul 16 17:22:37.128296 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:22:37.128265    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd031a3_9511_40ae_b54d_3e174e6fb546.slice/crio-e5b7470e2f09e15154c6ec1e2beda6ef2b4bf707d8b9ffbc2c7672723cd5c1e6 WatchSource:0}: Error finding container e5b7470e2f09e15154c6ec1e2beda6ef2b4bf707d8b9ffbc2c7672723cd5c1e6: Status 404 returned error can't find the container with id e5b7470e2f09e15154c6ec1e2beda6ef2b4bf707d8b9ffbc2c7672723cd5c1e6
Jul 16 17:22:37.667824 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:37.667784    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bqk2x" event={"ID":"9cd031a3-9511-40ae-b54d-3e174e6fb546","Type":"ContainerStarted","Data":"e5b7470e2f09e15154c6ec1e2beda6ef2b4bf707d8b9ffbc2c7672723cd5c1e6"}
Jul 16 17:22:40.681197 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:40.681068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bqk2x" event={"ID":"9cd031a3-9511-40ae-b54d-3e174e6fb546","Type":"ContainerStarted","Data":"7d97084dfca694c301b9c0dbc4bd62ee6cc3aa8d62318c78dc62ab4f0619ac6f"}
Jul 16 17:22:40.681197 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:40.681181    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:22:40.700123 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:40.700067    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-bqk2x" podStartSLOduration=1.5205213130000002 podStartE2EDuration="4.700054437s" totalImagesPullingTime="3.179533124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:22:40.698884849 +0000 UTC m=+531.413401524" watchObservedRunningTime="2026-07-16 17:22:40.700054437 +0000 UTC m=+531.414571162"
Jul 16 17:22:46.687288 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:22:46.687256    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-bqk2x"
Jul 16 17:23:49.729083 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:49.729056    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:23:49.731615 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:49.731588    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:23:57.712291 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.712261    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"]
Jul 16 17:23:57.714583 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.714567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.719229 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.719206    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 17:23:57.719358 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.719260    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:23:57.720273 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.720247    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nvrng\""
Jul 16 17:23:57.727803 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.727748    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"]
Jul 16 17:23:57.764395 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.764369    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7lnc\" (UniqueName: \"kubernetes.io/projected/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-kube-api-access-b7lnc\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.764517 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.764400    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.865432 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.865402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7lnc\" (UniqueName: \"kubernetes.io/projected/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-kube-api-access-b7lnc\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.865432 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.865433    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.865755 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.865741    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:57.875893 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:57.875867    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7lnc\" (UniqueName: \"kubernetes.io/projected/31f9a425-4bc2-4f6d-aa10-91bbf2bccaba-kube-api-access-b7lnc\") pod \"openshift-lws-operator-fd8ccff4c-dl9mp\" (UID: \"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:58.022586 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:58.022483    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"
Jul 16 17:23:58.151611 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:58.151591    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp"]
Jul 16 17:23:58.155950 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:23:58.155191    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31f9a425_4bc2_4f6d_aa10_91bbf2bccaba.slice/crio-947a212553ce1dbbb9ddbdb22d3e9cf53f765d1e329c99f1499264b9055c6c57 WatchSource:0}: Error finding container 947a212553ce1dbbb9ddbdb22d3e9cf53f765d1e329c99f1499264b9055c6c57: Status 404 returned error can't find the container with id 947a212553ce1dbbb9ddbdb22d3e9cf53f765d1e329c99f1499264b9055c6c57
Jul 16 17:23:58.942861 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:23:58.942828    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp" event={"ID":"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba","Type":"ContainerStarted","Data":"947a212553ce1dbbb9ddbdb22d3e9cf53f765d1e329c99f1499264b9055c6c57"}
Jul 16 17:24:01.957606 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:01.957564    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp" event={"ID":"31f9a425-4bc2-4f6d-aa10-91bbf2bccaba","Type":"ContainerStarted","Data":"4b058e8949db192d9b650252a48369541cf66ff03a56e1939c26c208a1aa319d"}
Jul 16 17:24:01.988442 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:01.988338    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dl9mp" podStartSLOduration=1.426678917 podStartE2EDuration="4.988323293s" totalImagesPullingTime="3.561644376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:01.988232848 +0000 UTC m=+612.702749522" watchObservedRunningTime="2026-07-16 17:24:01.988323293 +0000 UTC m=+612.702839967"
Jul 16 17:24:11.826470 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.826400    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"]
Jul 16 17:24:11.829509 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.829494    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.833952 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.833928    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 17:24:11.834073 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.833934    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-65mct\""
Jul 16 17:24:11.835048 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.835032    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 17:24:11.835182 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.835073    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 17:24:11.850371 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.850350    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"]
Jul 16 17:24:11.866964 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.866944    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-manager-config\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.867067 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.866984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkhx\" (UniqueName: \"kubernetes.io/projected/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-kube-api-access-wqkhx\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.867067 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.867009    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-metrics-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.867168 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.867071    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.967552 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.967521    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkhx\" (UniqueName: \"kubernetes.io/projected/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-kube-api-access-wqkhx\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.967685 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.967566    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-metrics-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.967685 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.967594    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.967685 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.967645    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-manager-config\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.968301 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.968279    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-manager-config\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.970098 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.970076    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.970230 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.970145    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-metrics-cert\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:11.986612 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:11.986587    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkhx\" (UniqueName: \"kubernetes.io/projected/641b00d6-b871-4cee-a2ff-946d1ea1f3e0-kube-api-access-wqkhx\") pod \"lws-controller-manager-558b5fdc8c-7458b\" (UID: \"641b00d6-b871-4cee-a2ff-946d1ea1f3e0\") " pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:12.138204 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:12.138089    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:12.285075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:12.284929    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"]
Jul 16 17:24:12.288740 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:24:12.288695    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641b00d6_b871_4cee_a2ff_946d1ea1f3e0.slice/crio-7c0d7f9282d1a081517d25eb8ebc619f9ee858b0297657ca86a0533d658c5bcf WatchSource:0}: Error finding container 7c0d7f9282d1a081517d25eb8ebc619f9ee858b0297657ca86a0533d658c5bcf: Status 404 returned error can't find the container with id 7c0d7f9282d1a081517d25eb8ebc619f9ee858b0297657ca86a0533d658c5bcf
Jul 16 17:24:12.999446 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:12.999404    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b" event={"ID":"641b00d6-b871-4cee-a2ff-946d1ea1f3e0","Type":"ContainerStarted","Data":"7c0d7f9282d1a081517d25eb8ebc619f9ee858b0297657ca86a0533d658c5bcf"}
Jul 16 17:24:14.004254 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:14.004216    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b" event={"ID":"641b00d6-b871-4cee-a2ff-946d1ea1f3e0","Type":"ContainerStarted","Data":"063388aa278947d0c560f52c1a4b4815c8c10cdf4f800e03ca5322d9647fc279"}
Jul 16 17:24:14.004592 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:14.004302    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:14.048782 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:14.048736    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b" podStartSLOduration=1.518584481 podStartE2EDuration="3.048721735s" totalImagesPullingTime="1.530137254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:24:14.048229363 +0000 UTC m=+624.762746055" watchObservedRunningTime="2026-07-16 17:24:14.048721735 +0000 UTC m=+624.763238410"
Jul 16 17:24:25.010175 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:25.010144    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-558b5fdc8c-7458b"
Jul 16 17:24:59.446807 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.446772    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"]
Jul 16 17:24:59.449457 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.449443    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.452318 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.452296    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 17:24:59.452429 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.452299    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 17:24:59.453234 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.453216    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 17:24:59.453319 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.453251    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 17:24:59.453319 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.453262    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cppvr\""
Jul 16 17:24:59.460680 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.460658    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"]
Jul 16 17:24:59.610984 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.610956    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.610984 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.610984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldb2n\" (UniqueName: \"kubernetes.io/projected/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-kube-api-access-ldb2n\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.611155 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.611015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.712286 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.712213    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.712286 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.712247    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldb2n\" (UniqueName: \"kubernetes.io/projected/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-kube-api-access-ldb2n\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.712427 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.712286    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.712932 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.712914    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.714777 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.714756    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.723206 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.723182    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldb2n\" (UniqueName: \"kubernetes.io/projected/4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6-kube-api-access-ldb2n\") pod \"kuadrant-console-plugin-85fd4b8b9d-m6wrp\" (UID: \"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.759165 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.759143    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"
Jul 16 17:24:59.915002 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:24:59.914961    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp"]
Jul 16 17:24:59.917098 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:24:59.917071    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e96a427_cdcf_4760_b0fb_6bc4ed5b63f6.slice/crio-e15c893f9560c077eb6cfdf19fc531c1a2cd3b91fba78654b376faa8d5f70a42 WatchSource:0}: Error finding container e15c893f9560c077eb6cfdf19fc531c1a2cd3b91fba78654b376faa8d5f70a42: Status 404 returned error can't find the container with id e15c893f9560c077eb6cfdf19fc531c1a2cd3b91fba78654b376faa8d5f70a42
Jul 16 17:25:00.166751 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:00.166663    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp" event={"ID":"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6","Type":"ContainerStarted","Data":"e15c893f9560c077eb6cfdf19fc531c1a2cd3b91fba78654b376faa8d5f70a42"}
Jul 16 17:25:06.193178 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:06.193140    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp" event={"ID":"4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6","Type":"ContainerStarted","Data":"13df6c453110cdc227c65134d1d1d67cfa069f111367fcc71e0f392386d871ee"}
Jul 16 17:25:06.215744 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:06.215704    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-m6wrp" podStartSLOduration=1.858595973 podStartE2EDuration="7.215689597s" totalImagesPullingTime="5.357093624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:25:06.214825828 +0000 UTC m=+676.929342502" watchObservedRunningTime="2026-07-16 17:25:06.215689597 +0000 UTC m=+676.930206251"
Jul 16 17:25:40.986140 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:40.986041    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:41.003360 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.003335    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:41.003493 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.003426    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:41.006700 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.006679    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hsl8z\""
Jul 16 17:25:41.112515 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.112484    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf467\" (UniqueName: \"kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467\") pod \"authorino-b6c89bb85-xnpk7\" (UID: \"21cf2f8f-3002-46a6-91b1-271523e7073a\") " pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:41.213577 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.213542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf467\" (UniqueName: \"kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467\") pod \"authorino-b6c89bb85-xnpk7\" (UID: \"21cf2f8f-3002-46a6-91b1-271523e7073a\") " pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:41.227914 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.227882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf467\" (UniqueName: \"kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467\") pod \"authorino-b6c89bb85-xnpk7\" (UID: \"21cf2f8f-3002-46a6-91b1-271523e7073a\") " pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:41.295882 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.295815    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:25:41.297805 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.297789    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:25:41.312923 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.312904    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:41.319951 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.319927    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:25:41.415054 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.415018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4rv\" (UniqueName: \"kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv\") pod \"authorino-8df697c9f-vs8lj\" (UID: \"ecc6df3f-56a8-431e-b120-bc93973341dd\") " pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:25:41.474046 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.474014    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:41.479588 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:25:41.479561    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21cf2f8f_3002_46a6_91b1_271523e7073a.slice/crio-217d13ae661baba01cf6f0a553b4d6773bd01c5768f42a05424efed9a1b5bd66 WatchSource:0}: Error finding container 217d13ae661baba01cf6f0a553b4d6773bd01c5768f42a05424efed9a1b5bd66: Status 404 returned error can't find the container with id 217d13ae661baba01cf6f0a553b4d6773bd01c5768f42a05424efed9a1b5bd66
Jul 16 17:25:41.516026 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.516001    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4rv\" (UniqueName: \"kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv\") pod \"authorino-8df697c9f-vs8lj\" (UID: \"ecc6df3f-56a8-431e-b120-bc93973341dd\") " pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:25:41.531291 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.531263    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4rv\" (UniqueName: \"kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv\") pod \"authorino-8df697c9f-vs8lj\" (UID: \"ecc6df3f-56a8-431e-b120-bc93973341dd\") " pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:25:41.606994 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.606900    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:25:41.748549 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:41.748519    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:25:41.752136 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:25:41.752091    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecc6df3f_56a8_431e_b120_bc93973341dd.slice/crio-eaf1156cacc2b9e9bd4977defe6c0f87b334eafd19edb1be1464d18dacd53116 WatchSource:0}: Error finding container eaf1156cacc2b9e9bd4977defe6c0f87b334eafd19edb1be1464d18dacd53116: Status 404 returned error can't find the container with id eaf1156cacc2b9e9bd4977defe6c0f87b334eafd19edb1be1464d18dacd53116
Jul 16 17:25:42.322697 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:42.322659    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" event={"ID":"21cf2f8f-3002-46a6-91b1-271523e7073a","Type":"ContainerStarted","Data":"217d13ae661baba01cf6f0a553b4d6773bd01c5768f42a05424efed9a1b5bd66"}
Jul 16 17:25:42.323763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:42.323740    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-vs8lj" event={"ID":"ecc6df3f-56a8-431e-b120-bc93973341dd","Type":"ContainerStarted","Data":"eaf1156cacc2b9e9bd4977defe6c0f87b334eafd19edb1be1464d18dacd53116"}
Jul 16 17:25:44.333065 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:44.333018    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" event={"ID":"21cf2f8f-3002-46a6-91b1-271523e7073a","Type":"ContainerStarted","Data":"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"}
Jul 16 17:25:44.334498 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:44.334474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-vs8lj" event={"ID":"ecc6df3f-56a8-431e-b120-bc93973341dd","Type":"ContainerStarted","Data":"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"}
Jul 16 17:25:44.355158 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:44.355098    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" podStartSLOduration=2.230269745 podStartE2EDuration="4.355083355s" totalImagesPullingTime="2.12481361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:25:44.354746761 +0000 UTC m=+715.069263434" watchObservedRunningTime="2026-07-16 17:25:44.355083355 +0000 UTC m=+715.069600028"
Jul 16 17:25:44.377865 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:44.377817    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8df697c9f-vs8lj" podStartSLOduration=1.5264646800000001 podStartE2EDuration="3.377795482s" totalImagesPullingTime="1.851330802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:25:44.377030982 +0000 UTC m=+715.091547655" watchObservedRunningTime="2026-07-16 17:25:44.377795482 +0000 UTC m=+715.092312157"
Jul 16 17:25:44.445121 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:44.445073    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:46.342177 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:46.342135    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" podUID="21cf2f8f-3002-46a6-91b1-271523e7073a" containerName="authorino" containerID="cri-o://ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5" gracePeriod=30
Jul 16 17:25:46.592911 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:46.592859    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:46.653767 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:46.653735    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf467\" (UniqueName: \"kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467\") pod \"21cf2f8f-3002-46a6-91b1-271523e7073a\" (UID: \"21cf2f8f-3002-46a6-91b1-271523e7073a\") "
Jul 16 17:25:46.655932 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:46.655904    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467" (OuterVolumeSpecName: "kube-api-access-nf467") pod "21cf2f8f-3002-46a6-91b1-271523e7073a" (UID: "21cf2f8f-3002-46a6-91b1-271523e7073a"). InnerVolumeSpecName "kube-api-access-nf467". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:25:46.755123 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:46.755087    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf467\" (UniqueName: \"kubernetes.io/projected/21cf2f8f-3002-46a6-91b1-271523e7073a-kube-api-access-nf467\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:25:47.346699 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.346667    2555 generic.go:356] "Generic (PLEG): container finished" podID="21cf2f8f-3002-46a6-91b1-271523e7073a" containerID="ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5" exitCode=0
Jul 16 17:25:47.347208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.346710    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-xnpk7"
Jul 16 17:25:47.347208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.346706    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" event={"ID":"21cf2f8f-3002-46a6-91b1-271523e7073a","Type":"ContainerDied","Data":"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"}
Jul 16 17:25:47.347208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.346753    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-xnpk7" event={"ID":"21cf2f8f-3002-46a6-91b1-271523e7073a","Type":"ContainerDied","Data":"217d13ae661baba01cf6f0a553b4d6773bd01c5768f42a05424efed9a1b5bd66"}
Jul 16 17:25:47.347208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.346769    2555 scope.go:117] "RemoveContainer" containerID="ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"
Jul 16 17:25:47.357344 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.357269    2555 scope.go:117] "RemoveContainer" containerID="ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"
Jul 16 17:25:47.357832 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:25:47.357801    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5\": container with ID starting with ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5 not found: ID does not exist" containerID="ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"
Jul 16 17:25:47.357832 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.357827    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5"} err="failed to get container status \"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5\": rpc error: code = NotFound desc = could not find container \"ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5\": container with ID starting with ae652efb42b489f2040415054c6f142632a4ef2e927c4ea5fb947abbb83a3ca5 not found: ID does not exist"
Jul 16 17:25:47.385752 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.385725    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:47.401244 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.401223    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-xnpk7"]
Jul 16 17:25:47.843833 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:25:47.843800    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21cf2f8f-3002-46a6-91b1-271523e7073a" path="/var/lib/kubelet/pods/21cf2f8f-3002-46a6-91b1-271523e7073a/volumes"
Jul 16 17:26:07.444198 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.444167    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c77957575-xc96s"]
Jul 16 17:26:07.444589 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.444433    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21cf2f8f-3002-46a6-91b1-271523e7073a" containerName="authorino"
Jul 16 17:26:07.444589 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.444444    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="21cf2f8f-3002-46a6-91b1-271523e7073a" containerName="authorino"
Jul 16 17:26:07.444589 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.444489    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="21cf2f8f-3002-46a6-91b1-271523e7073a" containerName="authorino"
Jul 16 17:26:07.446901 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.446885    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.462086 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.462038    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 17:26:07.463983 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.463964    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-xc96s"]
Jul 16 17:26:07.507695 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.507670    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa6a1664-1753-41af-a47d-25d5cf8f55da-tls-cert\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.507815 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.507715    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w88bz\" (UniqueName: \"kubernetes.io/projected/fa6a1664-1753-41af-a47d-25d5cf8f55da-kube-api-access-w88bz\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.608043 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.608012    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w88bz\" (UniqueName: \"kubernetes.io/projected/fa6a1664-1753-41af-a47d-25d5cf8f55da-kube-api-access-w88bz\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.608318 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.608065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa6a1664-1753-41af-a47d-25d5cf8f55da-tls-cert\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.610707 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.610685    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fa6a1664-1753-41af-a47d-25d5cf8f55da-tls-cert\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.623191 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.623167    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w88bz\" (UniqueName: \"kubernetes.io/projected/fa6a1664-1753-41af-a47d-25d5cf8f55da-kube-api-access-w88bz\") pod \"authorino-7c77957575-xc96s\" (UID: \"fa6a1664-1753-41af-a47d-25d5cf8f55da\") " pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.755302 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.755223    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c77957575-xc96s"
Jul 16 17:26:07.886298 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:07.886270    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c77957575-xc96s"]
Jul 16 17:26:07.888765 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:26:07.888738    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa6a1664_1753_41af_a47d_25d5cf8f55da.slice/crio-c413b3ad3deebae3e1b565f4892096988bcb2bee50cb49ca2e2cd79329733476 WatchSource:0}: Error finding container c413b3ad3deebae3e1b565f4892096988bcb2bee50cb49ca2e2cd79329733476: Status 404 returned error can't find the container with id c413b3ad3deebae3e1b565f4892096988bcb2bee50cb49ca2e2cd79329733476
Jul 16 17:26:08.423796 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:08.423759    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-xc96s" event={"ID":"fa6a1664-1753-41af-a47d-25d5cf8f55da","Type":"ContainerStarted","Data":"c413b3ad3deebae3e1b565f4892096988bcb2bee50cb49ca2e2cd79329733476"}
Jul 16 17:26:09.429021 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.428983    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c77957575-xc96s" event={"ID":"fa6a1664-1753-41af-a47d-25d5cf8f55da","Type":"ContainerStarted","Data":"879dc2210d6c80b7c33b73f55335eeedf14d7ea3ad01392a33e743c52b01e58b"}
Jul 16 17:26:09.447901 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.447855    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c77957575-xc96s" podStartSLOduration=1.866107247 podStartE2EDuration="2.44783925s" totalImagesPullingTime="581.732003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:26:09.446890046 +0000 UTC m=+740.161406720" watchObservedRunningTime="2026-07-16 17:26:09.44783925 +0000 UTC m=+740.162355924"
Jul 16 17:26:09.515188 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.515158    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:26:09.515355 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.515334    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8df697c9f-vs8lj" podUID="ecc6df3f-56a8-431e-b120-bc93973341dd" containerName="authorino" containerID="cri-o://8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1" gracePeriod=30
Jul 16 17:26:09.757975 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.757952    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:26:09.824759 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.824732    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x4rv\" (UniqueName: \"kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv\") pod \"ecc6df3f-56a8-431e-b120-bc93973341dd\" (UID: \"ecc6df3f-56a8-431e-b120-bc93973341dd\") "
Jul 16 17:26:09.826881 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.826851    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv" (OuterVolumeSpecName: "kube-api-access-4x4rv") pod "ecc6df3f-56a8-431e-b120-bc93973341dd" (UID: "ecc6df3f-56a8-431e-b120-bc93973341dd"). InnerVolumeSpecName "kube-api-access-4x4rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:26:09.925223 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:09.925196    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x4rv\" (UniqueName: \"kubernetes.io/projected/ecc6df3f-56a8-431e-b120-bc93973341dd-kube-api-access-4x4rv\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:26:10.434017 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.433985    2555 generic.go:356] "Generic (PLEG): container finished" podID="ecc6df3f-56a8-431e-b120-bc93973341dd" containerID="8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1" exitCode=0
Jul 16 17:26:10.434445 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.434029    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-vs8lj"
Jul 16 17:26:10.434445 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.434071    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-vs8lj" event={"ID":"ecc6df3f-56a8-431e-b120-bc93973341dd","Type":"ContainerDied","Data":"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"}
Jul 16 17:26:10.434445 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.434136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-vs8lj" event={"ID":"ecc6df3f-56a8-431e-b120-bc93973341dd","Type":"ContainerDied","Data":"eaf1156cacc2b9e9bd4977defe6c0f87b334eafd19edb1be1464d18dacd53116"}
Jul 16 17:26:10.434445 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.434158    2555 scope.go:117] "RemoveContainer" containerID="8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"
Jul 16 17:26:10.442038 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.442023    2555 scope.go:117] "RemoveContainer" containerID="8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"
Jul 16 17:26:10.442308 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:26:10.442286    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1\": container with ID starting with 8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1 not found: ID does not exist" containerID="8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"
Jul 16 17:26:10.442380 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.442320    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1"} err="failed to get container status \"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1\": rpc error: code = NotFound desc = could not find container \"8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1\": container with ID starting with 8d16297afab537bce54beae5cdb8cf934d4f730c4c5be17aff5c3208290bbbb1 not found: ID does not exist"
Jul 16 17:26:10.456143 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.456098    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:26:10.462655 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:10.462637    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8df697c9f-vs8lj"]
Jul 16 17:26:11.843556 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:26:11.843526    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc6df3f-56a8-431e-b120-bc93973341dd" path="/var/lib/kubelet/pods/ecc6df3f-56a8-431e-b120-bc93973341dd/volumes"
Jul 16 17:27:03.666406 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.666372    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-54lxp"]
Jul 16 17:27:03.666804 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.666675    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc6df3f-56a8-431e-b120-bc93973341dd" containerName="authorino"
Jul 16 17:27:03.666804 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.666688    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc6df3f-56a8-431e-b120-bc93973341dd" containerName="authorino"
Jul 16 17:27:03.666804 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.666759    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc6df3f-56a8-431e-b120-bc93973341dd" containerName="authorino"
Jul 16 17:27:03.671720 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.671704    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.680149 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.680095    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-54lxp"]
Jul 16 17:27:03.711296 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.711273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxjjg\" (UniqueName: \"kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.711399 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.711304    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.812018 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.811987    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjjg\" (UniqueName: \"kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.812018 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.812024    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.812355 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.812341    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.824040 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.824021    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjjg\" (UniqueName: \"kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg\") pod \"s3-init-54lxp\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") " pod="kserve/s3-init-54lxp"
Jul 16 17:27:03.981170 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:03.981140    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-54lxp"
Jul 16 17:27:04.111510 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:04.111489    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-54lxp"]
Jul 16 17:27:04.113746 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:27:04.113718    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e4ff1a7_ea61_4396_bb09_5a000462c20f.slice/crio-520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3 WatchSource:0}: Error finding container 520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3: Status 404 returned error can't find the container with id 520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3
Jul 16 17:27:04.115654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:04.115636    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:27:04.634627 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:04.634593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerStarted","Data":"520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3"}
Jul 16 17:27:09.658941 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:09.658901    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerStarted","Data":"07dbdb93cda185339d95e68360fe23157db26b38984a76f0f1233977ef455c67"}
Jul 16 17:27:10.664198 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:10.664127    2555 generic.go:356] "Generic (PLEG): container finished" podID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerID="07dbdb93cda185339d95e68360fe23157db26b38984a76f0f1233977ef455c67" exitCode=0
Jul 16 17:27:10.664198 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:10.664164    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerDied","Data":"07dbdb93cda185339d95e68360fe23157db26b38984a76f0f1233977ef455c67"}
Jul 16 17:27:15.689089 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:15.689052    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerStarted","Data":"11908cba7ce9decc5346724973f58c2b002d9755197dbb9d39fbdf8ac33fcdc1"}
Jul 16 17:27:15.710418 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:27:15.710367    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-54lxp" podStartSLOduration=2.547443331 podStartE2EDuration="12.71035205s" totalImagesPullingTime="9.051319299s" totalInitContainerRuntime="1.11158942s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:27:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:27:15.708517733 +0000 UTC m=+806.423034407" watchObservedRunningTime="2026-07-16 17:27:15.71035205 +0000 UTC m=+806.424868724"
Jul 16 17:28:20.925365 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:20.925331    2555 generic.go:356] "Generic (PLEG): container finished" podID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerID="11908cba7ce9decc5346724973f58c2b002d9755197dbb9d39fbdf8ac33fcdc1" exitCode=0
Jul 16 17:28:20.925749 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:20.925405    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerDied","Data":"11908cba7ce9decc5346724973f58c2b002d9755197dbb9d39fbdf8ac33fcdc1"}
Jul 16 17:28:22.054892 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.054870    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-54lxp"
Jul 16 17:28:22.090529 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.090504    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache\") pod \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") "
Jul 16 17:28:22.090673 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.090550    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxjjg\" (UniqueName: \"kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg\") pod \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\" (UID: \"9e4ff1a7-ea61-4396-bb09-5a000462c20f\") "
Jul 16 17:28:22.092812 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.092788    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg" (OuterVolumeSpecName: "kube-api-access-sxjjg") pod "9e4ff1a7-ea61-4396-bb09-5a000462c20f" (UID: "9e4ff1a7-ea61-4396-bb09-5a000462c20f"). InnerVolumeSpecName "kube-api-access-sxjjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:28:22.109213 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.109189    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e4ff1a7-ea61-4396-bb09-5a000462c20f" (UID: "9e4ff1a7-ea61-4396-bb09-5a000462c20f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:28:22.191570 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.191508    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e4ff1a7-ea61-4396-bb09-5a000462c20f-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:28:22.191570 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.191532    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxjjg\" (UniqueName: \"kubernetes.io/projected/9e4ff1a7-ea61-4396-bb09-5a000462c20f-kube-api-access-sxjjg\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:28:22.934598 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.934566    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-54lxp" event={"ID":"9e4ff1a7-ea61-4396-bb09-5a000462c20f","Type":"ContainerDied","Data":"520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3"}
Jul 16 17:28:22.934598 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.934582    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-54lxp"
Jul 16 17:28:22.934598 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:22.934604    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="520fa4130ea7dd59c0d696c4238793080f7567ed44701d9719f1a3848c50bab3"
Jul 16 17:28:47.479793 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.479708    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:28:47.480385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.480123    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerName="download-hf-model"
Jul 16 17:28:47.480385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.480141    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerName="download-hf-model"
Jul 16 17:28:47.480385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.480177    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerName="s3-init"
Jul 16 17:28:47.480385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.480187    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerName="s3-init"
Jul 16 17:28:47.480385 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.480258    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e4ff1a7-ea61-4396-bb09-5a000462c20f" containerName="s3-init"
Jul 16 17:28:47.483311 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.483289    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.487042 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.487023    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 16 17:28:47.487560 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.487546    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 16 17:28:47.487612 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.487552    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 16 17:28:47.487651 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.487558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-sdm8r\""
Jul 16 17:28:47.487651 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.487552    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-dockercfg-ssxjm\""
Jul 16 17:28:47.508558 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.508527    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:28:47.564047 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564024    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.564163 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564064    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.564208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564169    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.564208 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564198    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.564274 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.564274 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.564248    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vsq\" (UniqueName: \"kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.664787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664745    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.664787 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664786    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665007 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664808    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665007 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664827    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vsq\" (UniqueName: \"kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665007 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665007 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.664910    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665252 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.665183    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665305 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.665285    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.665371 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.665355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.667050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.667026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.667397 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.667377    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.674970 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.674951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vsq\" (UniqueName: \"kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq\") pod \"scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.811964 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.811893    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:47.968139 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:47.968075    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:28:47.970349 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:28:47.970319    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5923bb64_6e19_4cfe_8213_61a331c22b41.slice/crio-39b6acb1438a04db9a0273dbe3c3275300f5199767cc63f85537fb79a34b8bcd WatchSource:0}: Error finding container 39b6acb1438a04db9a0273dbe3c3275300f5199767cc63f85537fb79a34b8bcd: Status 404 returned error can't find the container with id 39b6acb1438a04db9a0273dbe3c3275300f5199767cc63f85537fb79a34b8bcd
Jul 16 17:28:48.021505 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:48.021479    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerStarted","Data":"39b6acb1438a04db9a0273dbe3c3275300f5199767cc63f85537fb79a34b8bcd"}
Jul 16 17:28:50.300291 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:50.300261    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:28:50.300830 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:50.300808    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:28:51.035761 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:51.035731    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerStarted","Data":"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"}
Jul 16 17:28:51.035952 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:51.035840    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:53.046648 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:53.046612    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerStarted","Data":"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"}
Jul 16 17:28:53.071646 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:53.071594    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" podStartSLOduration=2.225847292 podStartE2EDuration="6.071580457s" totalImagesPullingTime="3.845733165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:28:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:28:53.069999511 +0000 UTC m=+903.784516184" watchObservedRunningTime="2026-07-16 17:28:53.071580457 +0000 UTC m=+903.786097134"
Jul 16 17:28:53.812143 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:53.812083    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:57.812708 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:57.812679    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:57.824865 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:57.824845    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:28:58.078169 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:28:58.078070    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:29:01.634139 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.634089    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"]
Jul 16 17:29:01.637366 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.637348    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.640663 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.640642    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"fc-smoke-test-epp-sa-dockercfg-rf745\""
Jul 16 17:29:01.640777 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.640691    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"fc-smoke-test-kserve-self-signed-certs\""
Jul 16 17:29:01.652191 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.652171    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"]
Jul 16 17:29:01.775668 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.775635    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tokenizer-uds\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.775822 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.775680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frvgm\" (UniqueName: \"kubernetes.io/projected/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-kube-api-access-frvgm\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.775822 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.775748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.876381 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.876346    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frvgm\" (UniqueName: \"kubernetes.io/projected/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-kube-api-access-frvgm\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.876544 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.876392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.876544 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.876434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tokenizer-uds\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.876740 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.876726    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tokenizer-uds\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.878934 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.878901    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-tls-certs\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.886959 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.886911    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frvgm\" (UniqueName: \"kubernetes.io/projected/f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb-kube-api-access-frvgm\") pod \"fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk\" (UID: \"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb\") " pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:01.946914 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:01.946881    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:02.079378 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:02.079351    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"]
Jul 16 17:29:02.080710 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:29:02.080689    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fc5b1f_d31f_41d4_ac8d_c7b4e33eeecb.slice/crio-69eba0ebfc6b3c4f04e91942a08e0b9fd1305c1e40a5652f1219581ba0d0c01c WatchSource:0}: Error finding container 69eba0ebfc6b3c4f04e91942a08e0b9fd1305c1e40a5652f1219581ba0d0c01c: Status 404 returned error can't find the container with id 69eba0ebfc6b3c4f04e91942a08e0b9fd1305c1e40a5652f1219581ba0d0c01c
Jul 16 17:29:03.089364 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:03.089305    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk" event={"ID":"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb","Type":"ContainerStarted","Data":"69eba0ebfc6b3c4f04e91942a08e0b9fd1305c1e40a5652f1219581ba0d0c01c"}
Jul 16 17:29:04.094601 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:04.094570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk" event={"ID":"f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb","Type":"ContainerStarted","Data":"e63772e9d3c4ddf9e5bcdd8ec2273cec903187071ed8f2547a93148ffaa99824"}
Jul 16 17:29:04.094973 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:04.094673    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:29:04.118514 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:04.118449    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk" podStartSLOduration=1.579741998 podStartE2EDuration="3.118428285s" totalImagesPullingTime="1.538686287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:04.117946635 +0000 UTC m=+914.832463308" watchObservedRunningTime="2026-07-16 17:29:04.118428285 +0000 UTC m=+914.832944961"
Jul 16 17:29:09.082593 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:09.082558    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:29:35.100612 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:29:35.100584    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk"
Jul 16 17:30:29.395977 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.395898    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:30:29.404896 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:30:29.404853    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 17:30:29.404896 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:30:29.404896 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:30:29.404896 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a" cmd=["/bin/sleep","15"]
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.404919    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" message="" err=<
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:30:29.404932    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="main" containerID="cri-o://5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"
Jul 16 17:30:29.405136 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.404976    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="main" containerID="cri-o://5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a" gracePeriod=60
Jul 16 17:30:29.622140 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.622075    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="llm-d-routing-sidecar" containerID="cri-o://21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5" gracePeriod=60
Jul 16 17:30:29.866541 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.866519    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:30:29.933497 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933471    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933510    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933534    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933566    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933610    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933654 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933656    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8vsq\" (UniqueName: \"kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq\") pod \"5923bb64-6e19-4cfe-8213-61a331c22b41\" (UID: \"5923bb64-6e19-4cfe-8213-61a331c22b41\") "
Jul 16 17:30:29.933922 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933718    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache" (OuterVolumeSpecName: "model-cache") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:30:29.933922 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933832    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:30:29.933922 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933870    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:29.934030 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.933922    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home" (OuterVolumeSpecName: "home") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:30:29.935904 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.935882    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:30:29.936009 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.935908    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq" (OuterVolumeSpecName: "kube-api-access-p8vsq") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "kube-api-access-p8vsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:30:29.936009 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:29.935957    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm" (OuterVolumeSpecName: "dshm") pod "5923bb64-6e19-4cfe-8213-61a331c22b41" (UID: "5923bb64-6e19-4cfe-8213-61a331c22b41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:30:30.035226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.035169    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8vsq\" (UniqueName: \"kubernetes.io/projected/5923bb64-6e19-4cfe-8213-61a331c22b41-kube-api-access-p8vsq\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:30.035226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.035191    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5923bb64-6e19-4cfe-8213-61a331c22b41-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:30.035226 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.035202    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:30.035400 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.035231    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:30.035400 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.035239    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5923bb64-6e19-4cfe-8213-61a331c22b41-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:30:30.424954 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424866    2555 generic.go:356] "Generic (PLEG): container finished" podID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a" exitCode=0
Jul 16 17:30:30.424954 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424891    2555 generic.go:356] "Generic (PLEG): container finished" podID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerID="21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5" exitCode=0
Jul 16 17:30:30.424954 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424912    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerDied","Data":"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"}
Jul 16 17:30:30.424954 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424932    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"
Jul 16 17:30:30.425561 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424961    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerDied","Data":"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"}
Jul 16 17:30:30.425561 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.424980    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx" event={"ID":"5923bb64-6e19-4cfe-8213-61a331c22b41","Type":"ContainerDied","Data":"39b6acb1438a04db9a0273dbe3c3275300f5199767cc63f85537fb79a34b8bcd"}
Jul 16 17:30:30.425561 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.425000    2555 scope.go:117] "RemoveContainer" containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"
Jul 16 17:30:30.434265 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.434251    2555 scope.go:117] "RemoveContainer" containerID="21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"
Jul 16 17:30:30.441142 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441121    2555 scope.go:117] "RemoveContainer" containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"
Jul 16 17:30:30.441387 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:30:30.441368    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a\": container with ID starting with 5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a not found: ID does not exist" containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"
Jul 16 17:30:30.441456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441400    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"} err="failed to get container status \"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a\": rpc error: code = NotFound desc = could not find container \"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a\": container with ID starting with 5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a not found: ID does not exist"
Jul 16 17:30:30.441456 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441425    2555 scope.go:117] "RemoveContainer" containerID="21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"
Jul 16 17:30:30.441694 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:30:30.441677    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5\": container with ID starting with 21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5 not found: ID does not exist" containerID="21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"
Jul 16 17:30:30.441731 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441701    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"} err="failed to get container status \"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5\": rpc error: code = NotFound desc = could not find container \"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5\": container with ID starting with 21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5 not found: ID does not exist"
Jul 16 17:30:30.441731 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441718    2555 scope.go:117] "RemoveContainer" containerID="5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"
Jul 16 17:30:30.441915 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441895    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a"} err="failed to get container status \"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a\": rpc error: code = NotFound desc = could not find container \"5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a\": container with ID starting with 5a9aeac07c7d46050fcee96039c3d45dea45b914199d1e001bfeb0edf1b0e03a not found: ID does not exist"
Jul 16 17:30:30.441971 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.441917    2555 scope.go:117] "RemoveContainer" containerID="21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"
Jul 16 17:30:30.442166 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.442141    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5"} err="failed to get container status \"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5\": rpc error: code = NotFound desc = could not find container \"21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5\": container with ID starting with 21e7ef90746e71d294cb4903a5be2f832b684704ee0fd4911ddbb1876dbcf4d5 not found: ID does not exist"
Jul 16 17:30:30.457691 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.457664    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:30:30.460224 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:30.460202    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-68f9854ff-82kzx"]
Jul 16 17:30:31.843841 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:31.843806    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" path="/var/lib/kubelet/pods/5923bb64-6e19-4cfe-8213-61a331c22b41/volumes"
Jul 16 17:30:53.547115 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547069    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547373    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="main"
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547386    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="main"
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547397    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="llm-d-routing-sidecar"
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547402    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="llm-d-routing-sidecar"
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547449    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="main"
Jul 16 17:30:53.547465 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.547459    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5923bb64-6e19-4cfe-8213-61a331c22b41" containerName="llm-d-routing-sidecar"
Jul 16 17:30:53.551488 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.551470    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.554177 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.554155    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-dockercfg-45x5c\""
Jul 16 17:30:53.555024 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.555004    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 16 17:30:53.586008 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.585978    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:30:53.707191 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707150    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.707343 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707226    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.707343 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.707343 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707277    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mql8w\" (UniqueName: \"kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.707343 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707307    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.707343 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.707330    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808429 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808357    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808429 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808404    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808429 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808661 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mql8w\" (UniqueName: \"kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808661 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808661 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808909 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808887    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808982 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808927    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.808982 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.808952    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.811350 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.811329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.811558 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.811540    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.821279 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.821250    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mql8w\" (UniqueName: \"kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w\") pod \"scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:53.860590 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:53.860574    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:54.017480 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:54.017339    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:30:54.020089 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:30:54.020051    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd543449c_3043_4361_9921_be5c533e1172.slice/crio-ff0d22caca5f58d50b68ff30f187e4427fa344e58ce4468bd279338804ae6936 WatchSource:0}: Error finding container ff0d22caca5f58d50b68ff30f187e4427fa344e58ce4468bd279338804ae6936: Status 404 returned error can't find the container with id ff0d22caca5f58d50b68ff30f187e4427fa344e58ce4468bd279338804ae6936
Jul 16 17:30:54.514220 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:54.514184    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerStarted","Data":"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"}
Jul 16 17:30:54.514382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:54.514236    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerStarted","Data":"ff0d22caca5f58d50b68ff30f187e4427fa344e58ce4468bd279338804ae6936"}
Jul 16 17:30:54.514382 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:54.514308    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:30:55.520516 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:55.520483    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerStarted","Data":"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"}
Jul 16 17:30:55.861092 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:30:55.861012    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:03.861289 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:03.861258    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:03.873803 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:03.873779    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:03.896996 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:03.896954    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" podStartSLOduration=10.896941615 podStartE2EDuration="10.896941615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:55.561601989 +0000 UTC m=+1026.276118663" watchObservedRunningTime="2026-07-16 17:31:03.896941615 +0000 UTC m=+1034.611458289"
Jul 16 17:31:04.566544 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:04.566516    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:04.567788 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:04.567767    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:30.728893 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:30.728859    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:31:30.742799 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:31:30.742762    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 17:31:30.742799 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:31:30.742799 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:31:30.742799 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac" cmd=["/bin/sleep","15"]
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:30.742810    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" message="" err=<
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:31:30.742821    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="main" containerID="cri-o://8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"
Jul 16 17:31:30.743025 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:30.742865    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="main" containerID="cri-o://8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac" gracePeriod=60
Jul 16 17:31:30.959762 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:30.959729    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="llm-d-routing-sidecar" containerID="cri-o://02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b" gracePeriod=60
Jul 16 17:31:31.206415 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.206389    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:31.283210 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283184    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mql8w\" (UniqueName: \"kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283346 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283216    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283346 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283240    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283346 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283275    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283346 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283316    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283554 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283361    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs\") pod \"d543449c-3043-4361-9921-be5c533e1172\" (UID: \"d543449c-3043-4361-9921-be5c533e1172\") "
Jul 16 17:31:31.283554 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283503    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home" (OuterVolumeSpecName: "home") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:31.283554 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283515    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:31.283697 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283567    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.283697 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283583    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.283697 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.283663    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache" (OuterVolumeSpecName: "model-cache") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:31.285490 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.285460    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w" (OuterVolumeSpecName: "kube-api-access-mql8w") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "kube-api-access-mql8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:31:31.285594 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.285496    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm" (OuterVolumeSpecName: "dshm") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:31:31.285594 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.285566    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d543449c-3043-4361-9921-be5c533e1172" (UID: "d543449c-3043-4361-9921-be5c533e1172"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:31:31.384845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.384787    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.384845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.384811    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d543449c-3043-4361-9921-be5c533e1172-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.384845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.384820    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mql8w\" (UniqueName: \"kubernetes.io/projected/d543449c-3043-4361-9921-be5c533e1172-kube-api-access-mql8w\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.384845 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.384830    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d543449c-3043-4361-9921-be5c533e1172-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:31:31.659953 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.659869    2555 generic.go:356] "Generic (PLEG): container finished" podID="d543449c-3043-4361-9921-be5c533e1172" containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac" exitCode=0
Jul 16 17:31:31.659953 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.659898    2555 generic.go:356] "Generic (PLEG): container finished" podID="d543449c-3043-4361-9921-be5c533e1172" containerID="02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b" exitCode=0
Jul 16 17:31:31.659953 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.659924    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"
Jul 16 17:31:31.660165 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.659963    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerDied","Data":"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"}
Jul 16 17:31:31.660165 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.660020    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerDied","Data":"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"}
Jul 16 17:31:31.660165 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.660037    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz" event={"ID":"d543449c-3043-4361-9921-be5c533e1172","Type":"ContainerDied","Data":"ff0d22caca5f58d50b68ff30f187e4427fa344e58ce4468bd279338804ae6936"}
Jul 16 17:31:31.660165 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.660058    2555 scope.go:117] "RemoveContainer" containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"
Jul 16 17:31:31.668716 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.668673    2555 scope.go:117] "RemoveContainer" containerID="02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"
Jul 16 17:31:31.676407 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.676390    2555 scope.go:117] "RemoveContainer" containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"
Jul 16 17:31:31.676645 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:31:31.676626    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac\": container with ID starting with 8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac not found: ID does not exist" containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"
Jul 16 17:31:31.676717 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.676658    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"} err="failed to get container status \"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac\": rpc error: code = NotFound desc = could not find container \"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac\": container with ID starting with 8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac not found: ID does not exist"
Jul 16 17:31:31.676717 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.676681    2555 scope.go:117] "RemoveContainer" containerID="02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"
Jul 16 17:31:31.676914 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:31:31.676899    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b\": container with ID starting with 02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b not found: ID does not exist" containerID="02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"
Jul 16 17:31:31.676975 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.676922    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"} err="failed to get container status \"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b\": rpc error: code = NotFound desc = could not find container \"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b\": container with ID starting with 02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b not found: ID does not exist"
Jul 16 17:31:31.676975 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.676940    2555 scope.go:117] "RemoveContainer" containerID="8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"
Jul 16 17:31:31.677214 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.677191    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac"} err="failed to get container status \"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac\": rpc error: code = NotFound desc = could not find container \"8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac\": container with ID starting with 8976c8729527ad6b9f6c4910e52712cb149ad1a50502404810e64e695b08f7ac not found: ID does not exist"
Jul 16 17:31:31.677214 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.677212    2555 scope.go:117] "RemoveContainer" containerID="02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"
Jul 16 17:31:31.677401 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.677386    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b"} err="failed to get container status \"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b\": rpc error: code = NotFound desc = could not find container \"02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b\": container with ID starting with 02204430d02d3da32a1bdb4e013503fdfcef297ddfe5f21cc97289166e8b869b not found: ID does not exist"
Jul 16 17:31:31.691945 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.691889    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:31:31.701582 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.701560    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5d54f65f57-27ctz"]
Jul 16 17:31:31.843871 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:31.843838    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d543449c-3043-4361-9921-be5c533e1172" path="/var/lib/kubelet/pods/d543449c-3043-4361-9921-be5c533e1172/volumes"
Jul 16 17:31:53.364709 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.364679    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.364933    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="main"
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.364943    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="main"
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.364958    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="llm-d-routing-sidecar"
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.364963    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="llm-d-routing-sidecar"
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.365018    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="llm-d-routing-sidecar"
Jul 16 17:31:53.365075 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.365027    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d543449c-3043-4361-9921-be5c533e1172" containerName="main"
Jul 16 17:31:53.368709 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.368692    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.373168 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.373145    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"precise-prefix-cache-test-kserve-self-signed-certs\""
Jul 16 17:31:53.374015 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.373996    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 16 17:31:53.391979 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.391950    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:31:53.442757 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442736    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.442865 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.442865 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.442945 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442876    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.442945 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442907    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvc2c\" (UniqueName: \"kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.442945 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.443056 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.442966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.543926 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.543890    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544080 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.543934    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544080 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.543972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544080 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544009    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544080 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544039    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544080 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvc2c\" (UniqueName: \"kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544374 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544096    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544374 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544347    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544399    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544478 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544419    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.544613 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.544594    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.546521 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.546501    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.546740 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.546723    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.555995 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.555953    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvc2c\" (UniqueName: \"kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c\") pod \"precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") " pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.677992 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.677934    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:31:53.820880 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:53.820855    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:31:53.823470 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:31:53.823443    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9983196_dd2f_4bca_8e38_b0bb44654f43.slice/crio-cafd6d6bf2d25d7fedbb09c69006a018c16664a3188b2bd351448a1ccd78c9f5 WatchSource:0}: Error finding container cafd6d6bf2d25d7fedbb09c69006a018c16664a3188b2bd351448a1ccd78c9f5: Status 404 returned error can't find the container with id cafd6d6bf2d25d7fedbb09c69006a018c16664a3188b2bd351448a1ccd78c9f5
Jul 16 17:31:54.750826 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:54.750786    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerStarted","Data":"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"}
Jul 16 17:31:54.751329 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:54.750843    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerStarted","Data":"cafd6d6bf2d25d7fedbb09c69006a018c16664a3188b2bd351448a1ccd78c9f5"}
Jul 16 17:31:57.763240 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:57.763210    2555 generic.go:356] "Generic (PLEG): container finished" podID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerID="42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f" exitCode=0
Jul 16 17:31:57.763600 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:57.763279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerDied","Data":"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"}
Jul 16 17:31:58.773969 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:58.773934    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerStarted","Data":"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"}
Jul 16 17:31:58.800497 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:58.800448    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" podStartSLOduration=2.711809789 podStartE2EDuration="5.800433362s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.088623573s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:31:58.798852107 +0000 UTC m=+1089.513368780" watchObservedRunningTime="2026-07-16 17:31:58.800433362 +0000 UTC m=+1089.514950035"
Jul 16 17:31:59.678988 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:31:59.678946    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:32:03.678810 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:32:03.678777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:32:03.691174 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:32:03.691154    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:32:03.809920 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:32:03.809892    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:33:40.005287 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.005214    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:33:40.014429 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:33:40.014393    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 17:33:40.014429 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:33:40.014429 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:33:40.014429 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d" cmd=["/bin/sleep","15"]
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.014446    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" message="" err=<
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:33:40.014459    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="main" containerID="cri-o://440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"
Jul 16 17:33:40.014702 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.014520    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="main" containerID="cri-o://440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d" gracePeriod=60
Jul 16 17:33:40.366507 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.366485    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:33:40.450759 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450727    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450759 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450764    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvc2c\" (UniqueName: \"kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450785    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450827    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450863    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450889    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.450985 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.450952    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm\") pod \"d9983196-dd2f-4bca-8e38-b0bb44654f43\" (UID: \"d9983196-dd2f-4bca-8e38-b0bb44654f43\") "
Jul 16 17:33:40.451244 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.451007    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:33:40.451244 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.451141    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home" (OuterVolumeSpecName: "home") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:33:40.451244 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.451230    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.451372 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.451249    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.451372 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.451236    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:33:40.453166 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.453136    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c" (OuterVolumeSpecName: "kube-api-access-fvc2c") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "kube-api-access-fvc2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:33:40.453166 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.453147    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:33:40.453400 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.453382    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm" (OuterVolumeSpecName: "dshm") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:33:40.510425 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.510394    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d9983196-dd2f-4bca-8e38-b0bb44654f43" (UID: "d9983196-dd2f-4bca-8e38-b0bb44654f43"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:33:40.552386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.552329    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvc2c\" (UniqueName: \"kubernetes.io/projected/d9983196-dd2f-4bca-8e38-b0bb44654f43-kube-api-access-fvc2c\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.552386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.552353    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9983196-dd2f-4bca-8e38-b0bb44654f43-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.552386 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.552369    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-kserve-provision-location\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.552596 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.552403    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:40.552596 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:40.552414    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9983196-dd2f-4bca-8e38-b0bb44654f43-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:33:41.169874 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.169833    2555 generic.go:356] "Generic (PLEG): container finished" podID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerID="440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d" exitCode=0
Jul 16 17:33:41.170308 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.169885    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"
Jul 16 17:33:41.170308 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.169900    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerDied","Data":"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"}
Jul 16 17:33:41.170308 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.169950    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz" event={"ID":"d9983196-dd2f-4bca-8e38-b0bb44654f43","Type":"ContainerDied","Data":"cafd6d6bf2d25d7fedbb09c69006a018c16664a3188b2bd351448a1ccd78c9f5"}
Jul 16 17:33:41.170308 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.169974    2555 scope.go:117] "RemoveContainer" containerID="440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"
Jul 16 17:33:41.179451 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.179434    2555 scope.go:117] "RemoveContainer" containerID="42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"
Jul 16 17:33:41.187170 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.187151    2555 scope.go:117] "RemoveContainer" containerID="440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"
Jul 16 17:33:41.187383 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:33:41.187366    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d\": container with ID starting with 440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d not found: ID does not exist" containerID="440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"
Jul 16 17:33:41.187424 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.187390    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d"} err="failed to get container status \"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d\": rpc error: code = NotFound desc = could not find container \"440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d\": container with ID starting with 440d4ddbc6a2edf456d72ae5ac3bac9c2c3eef3d6b3248144e9c8bcc924bef2d not found: ID does not exist"
Jul 16 17:33:41.187424 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.187411    2555 scope.go:117] "RemoveContainer" containerID="42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"
Jul 16 17:33:41.187665 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:33:41.187635    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f\": container with ID starting with 42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f not found: ID does not exist" containerID="42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"
Jul 16 17:33:41.187763 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.187671    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f"} err="failed to get container status \"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f\": rpc error: code = NotFound desc = could not find container \"42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f\": container with ID starting with 42d75a136eab4773a4fd2b4707b622fb0bc64879bcd79fc833b966ba8277d91f not found: ID does not exist"
Jul 16 17:33:41.198756 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.198732    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:33:41.205530 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.205510    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6d6c8b5f7c-nmsvz"]
Jul 16 17:33:41.847548 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:41.844620    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" path="/var/lib/kubelet/pods/d9983196-dd2f-4bca-8e38-b0bb44654f43/volumes"
Jul 16 17:33:50.325524 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:50.325492    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:33:50.326173 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:33:50.326153    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:34:09.890840 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.890810    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:09.891312 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.891202    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="main"
Jul 16 17:34:09.891312 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.891219    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="main"
Jul 16 17:34:09.891312 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.891235    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="storage-initializer"
Jul 16 17:34:09.891312 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.891243    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="storage-initializer"
Jul 16 17:34:09.891525 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.891336    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9983196-dd2f-4bca-8e38-b0bb44654f43" containerName="main"
Jul 16 17:34:09.894703 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.894684    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:09.898759 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.898732    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-p7ctr\""
Jul 16 17:34:09.899538 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.899522    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 16 17:34:09.913002 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:09.912973    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:10.078838 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.078809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.079069 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.078857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8phc\" (UniqueName: \"kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.079069 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.078919    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.179891 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.179813    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.179891 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.179870    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8phc\" (UniqueName: \"kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.180049 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.179897    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.180300 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.180276    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.182448 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.182427    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.198205 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.198169    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8phc\" (UniqueName: \"kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.204983 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.204960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:10.355185 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:10.355157    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:10.357629 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:34:10.357595    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0553b5c_e68b_4999_9525_774153f9677d.slice/crio-d637be7ac8ea860cfde87db0a61ad4d6b0320854b33b07ab92131c31fbe9654d WatchSource:0}: Error finding container d637be7ac8ea860cfde87db0a61ad4d6b0320854b33b07ab92131c31fbe9654d: Status 404 returned error can't find the container with id d637be7ac8ea860cfde87db0a61ad4d6b0320854b33b07ab92131c31fbe9654d
Jul 16 17:34:11.294961 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:11.294925    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" event={"ID":"b0553b5c-e68b-4999-9525-774153f9677d","Type":"ContainerStarted","Data":"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"}
Jul 16 17:34:11.295409 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:11.294971    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" event={"ID":"b0553b5c-e68b-4999-9525-774153f9677d","Type":"ContainerStarted","Data":"d637be7ac8ea860cfde87db0a61ad4d6b0320854b33b07ab92131c31fbe9654d"}
Jul 16 17:34:11.295409 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:11.295003    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:42.301094 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:42.301021    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:42.331135 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:42.331068    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" podStartSLOduration=33.331053287 podStartE2EDuration="33.331053287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:11.334724619 +0000 UTC m=+1222.049241292" watchObservedRunningTime="2026-07-16 17:34:42.331053287 +0000 UTC m=+1253.045569960"
Jul 16 17:34:44.000479 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:44.000440    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:52.300764 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:52.300717    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" podUID="b0553b5c-e68b-4999-9525-774153f9677d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 16 17:34:59.020776 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.020732    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" podUID="b0553b5c-e68b-4999-9525-774153f9677d" containerName="main" containerID="cri-o://a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f" gracePeriod=45
Jul 16 17:34:59.266605 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.266574    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:59.353890 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.353809    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds\") pod \"b0553b5c-e68b-4999-9525-774153f9677d\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") "
Jul 16 17:34:59.353890 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.353848    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8phc\" (UniqueName: \"kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc\") pod \"b0553b5c-e68b-4999-9525-774153f9677d\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") "
Jul 16 17:34:59.354084 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.353922    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs\") pod \"b0553b5c-e68b-4999-9525-774153f9677d\" (UID: \"b0553b5c-e68b-4999-9525-774153f9677d\") "
Jul 16 17:34:59.354149 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.354077    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "b0553b5c-e68b-4999-9525-774153f9677d" (UID: "b0553b5c-e68b-4999-9525-774153f9677d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:34:59.355993 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.355964    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc" (OuterVolumeSpecName: "kube-api-access-j8phc") pod "b0553b5c-e68b-4999-9525-774153f9677d" (UID: "b0553b5c-e68b-4999-9525-774153f9677d"). InnerVolumeSpecName "kube-api-access-j8phc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:34:59.356145 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.356098    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b0553b5c-e68b-4999-9525-774153f9677d" (UID: "b0553b5c-e68b-4999-9525-774153f9677d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:34:59.455216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.455181    2555 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/b0553b5c-e68b-4999-9525-774153f9677d-tokenizer-uds\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:34:59.455216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.455214    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8phc\" (UniqueName: \"kubernetes.io/projected/b0553b5c-e68b-4999-9525-774153f9677d-kube-api-access-j8phc\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:34:59.455216 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.455225    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0553b5c-e68b-4999-9525-774153f9677d-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 17:34:59.480423 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.480398    2555 generic.go:356] "Generic (PLEG): container finished" podID="b0553b5c-e68b-4999-9525-774153f9677d" containerID="a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f" exitCode=0
Jul 16 17:34:59.480535 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.480484    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" event={"ID":"b0553b5c-e68b-4999-9525-774153f9677d","Type":"ContainerDied","Data":"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"}
Jul 16 17:34:59.480535 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.480498    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"
Jul 16 17:34:59.480619 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.480550    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr" event={"ID":"b0553b5c-e68b-4999-9525-774153f9677d","Type":"ContainerDied","Data":"d637be7ac8ea860cfde87db0a61ad4d6b0320854b33b07ab92131c31fbe9654d"}
Jul 16 17:34:59.480619 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.480578    2555 scope.go:117] "RemoveContainer" containerID="a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"
Jul 16 17:34:59.489309 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.489295    2555 scope.go:117] "RemoveContainer" containerID="a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"
Jul 16 17:34:59.489557 ip-10-0-128-42 kubenswrapper[2555]: E0716 17:34:59.489536    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f\": container with ID starting with a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f not found: ID does not exist" containerID="a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"
Jul 16 17:34:59.489620 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.489567    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f"} err="failed to get container status \"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f\": rpc error: code = NotFound desc = could not find container \"a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f\": container with ID starting with a6f91f7fef3d76dfb4f46cdb22cd3b7faca9b5d513d7bb26ea534569e9dd1a3f not found: ID does not exist"
Jul 16 17:34:59.506958 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.506930    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:59.508314 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.508292    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schexb8dr"]
Jul 16 17:34:59.844631 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:34:59.844596    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0553b5c-e68b-4999-9525-774153f9677d" path="/var/lib/kubelet/pods/b0553b5c-e68b-4999-9525-774153f9677d/volumes"
Jul 16 17:35:12.110232 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.110193    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"]
Jul 16 17:35:12.110643 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.110625    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0553b5c-e68b-4999-9525-774153f9677d" containerName="main"
Jul 16 17:35:12.110694 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.110648    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0553b5c-e68b-4999-9525-774153f9677d" containerName="main"
Jul 16 17:35:12.110740 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.110729    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0553b5c-e68b-4999-9525-774153f9677d" containerName="main"
Jul 16 17:35:12.114210 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.114190    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.116917 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.116899    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-5b1e8f15-epp-sa-dockercfg-qkt7r\""
Jul 16 17:35:12.118100 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.118084    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs\""
Jul 16 17:35:12.129306 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.129287    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"]
Jul 16 17:35:12.148516 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.148487    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvxf\" (UniqueName: \"kubernetes.io/projected/25efbac3-e5a8-4520-8538-a2e5b11b616c-kube-api-access-ftvxf\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.148656 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.148545    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/25efbac3-e5a8-4520-8538-a2e5b11b616c-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.148656 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.148594    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25efbac3-e5a8-4520-8538-a2e5b11b616c-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.249698 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.249667    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/25efbac3-e5a8-4520-8538-a2e5b11b616c-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.249877 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.249705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25efbac3-e5a8-4520-8538-a2e5b11b616c-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.249877 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.249779    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvxf\" (UniqueName: \"kubernetes.io/projected/25efbac3-e5a8-4520-8538-a2e5b11b616c-kube-api-access-ftvxf\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.250050 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.250029    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/25efbac3-e5a8-4520-8538-a2e5b11b616c-tokenizer-uds\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.252393 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.252366    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25efbac3-e5a8-4520-8538-a2e5b11b616c-tls-certs\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.261418 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.261396    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvxf\" (UniqueName: \"kubernetes.io/projected/25efbac3-e5a8-4520-8538-a2e5b11b616c-kube-api-access-ftvxf\") pod \"llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk\" (UID: \"25efbac3-e5a8-4520-8538-a2e5b11b616c\") " pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.424550 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.424467    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:12.555487 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:12.555463    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"]
Jul 16 17:35:12.557860 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:35:12.557823    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25efbac3_e5a8_4520_8538_a2e5b11b616c.slice/crio-22055432aa884b7c0b600676c64b8955e104d234694e85eb17b305ef0b92175a WatchSource:0}: Error finding container 22055432aa884b7c0b600676c64b8955e104d234694e85eb17b305ef0b92175a: Status 404 returned error can't find the container with id 22055432aa884b7c0b600676c64b8955e104d234694e85eb17b305ef0b92175a
Jul 16 17:35:13.539610 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:13.539571    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk" event={"ID":"25efbac3-e5a8-4520-8538-a2e5b11b616c","Type":"ContainerStarted","Data":"0a45419ccba92450df1e0ec5067d5164f84df1d168d276aab4dd0767a7d4e9f0"}
Jul 16 17:35:13.540049 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:13.539625    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk" event={"ID":"25efbac3-e5a8-4520-8538-a2e5b11b616c","Type":"ContainerStarted","Data":"22055432aa884b7c0b600676c64b8955e104d234694e85eb17b305ef0b92175a"}
Jul 16 17:35:13.540049 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:13.539654    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:35:13.562005 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:13.561958    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk" podStartSLOduration=1.561943001 podStartE2EDuration="1.561943001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:13.561590302 +0000 UTC m=+1284.276106977" watchObservedRunningTime="2026-07-16 17:35:13.561943001 +0000 UTC m=+1284.276459675"
Jul 16 17:35:44.545262 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:35:44.545236    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk"
Jul 16 17:38:50.352501 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:38:50.352474    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:38:50.353219 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:38:50.353201    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:43:50.376056 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:43:50.376024    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:43:50.377998 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:43:50.377978    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:44:45.523258 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.523214    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"]
Jul 16 17:44:45.526349 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.526332    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.528862 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.528842    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"fc-concurrency-test-kserve-self-signed-certs\""
Jul 16 17:44:45.545099 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.545081    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"]
Jul 16 17:44:45.563012 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.562990    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.563137 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.563020    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.563137 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.563058    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-home\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.563254 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.563157    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.563254 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.563205    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9m5q\" (UniqueName: \"kubernetes.io/projected/6043697f-08b3-481c-a033-e1b8405f613d-kube-api-access-w9m5q\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.563330 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.563251    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6043697f-08b3-481c-a033-e1b8405f613d-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664133 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664071    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664133 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664130    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664364 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-home\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664364 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664364 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664253    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9m5q\" (UniqueName: \"kubernetes.io/projected/6043697f-08b3-481c-a033-e1b8405f613d-kube-api-access-w9m5q\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664364 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6043697f-08b3-481c-a033-e1b8405f613d-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664566 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664538    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664620 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664587    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-home\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.664675 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.664612    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.666644 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.666621    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6043697f-08b3-481c-a033-e1b8405f613d-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.666789 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.666773    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6043697f-08b3-481c-a033-e1b8405f613d-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.678847 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.676743    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9m5q\" (UniqueName: \"kubernetes.io/projected/6043697f-08b3-481c-a033-e1b8405f613d-kube-api-access-w9m5q\") pod \"fc-concurrency-test-kserve-b5d44467c-xdjqc\" (UID: \"6043697f-08b3-481c-a033-e1b8405f613d\") " pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.836415 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.836326    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:45.967966 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:45.967939    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"]
Jul 16 17:44:45.970133 ip-10-0-128-42 kubenswrapper[2555]: W0716 17:44:45.970069    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6043697f_08b3_481c_a033_e1b8405f613d.slice/crio-f358b74a2c68d0d17f8e4228d95be2c5aa48fbe33dcdf5f1c3b5eab983300ad6 WatchSource:0}: Error finding container f358b74a2c68d0d17f8e4228d95be2c5aa48fbe33dcdf5f1c3b5eab983300ad6: Status 404 returned error can't find the container with id f358b74a2c68d0d17f8e4228d95be2c5aa48fbe33dcdf5f1c3b5eab983300ad6
Jul 16 17:44:46.681146 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:46.681099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc" event={"ID":"6043697f-08b3-481c-a033-e1b8405f613d","Type":"ContainerStarted","Data":"8ff71335cf67038c8bb8b964b33fadf09dfbc71fd5a8e2d8f4e55ebfade10dcc"}
Jul 16 17:44:46.681617 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:46.681161    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc" event={"ID":"6043697f-08b3-481c-a033-e1b8405f613d","Type":"ContainerStarted","Data":"f358b74a2c68d0d17f8e4228d95be2c5aa48fbe33dcdf5f1c3b5eab983300ad6"}
Jul 16 17:44:46.699673 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:46.699622    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc" podStartSLOduration=1.6996077939999998 podStartE2EDuration="1.699607794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:46.698480472 +0000 UTC m=+1857.412997147" watchObservedRunningTime="2026-07-16 17:44:46.699607794 +0000 UTC m=+1857.414124468"
Jul 16 17:44:46.836584 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:46.836559    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:55.837337 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:55.837246    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:55.850221 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:55.850197    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:44:56.729765 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:44:56.729736    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/fc-concurrency-test-kserve-b5d44467c-xdjqc"
Jul 16 17:48:50.399558 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:48:50.399527    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:48:50.401884 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:48:50.401748    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:50:47.734198 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:50:47.734165    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 17:53:50.422068 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:53:50.421951    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:53:50.425839 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:53:50.424978    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:58:50.444923 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:58:50.444894    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 17:58:50.448168 ip-10-0-128-42 kubenswrapper[2555]: I0716 17:58:50.448148    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:00:28.900324 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:28.900281    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:28.903328 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:28.903313    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:28.905852 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:28.905833    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
Jul 16 18:00:28.912911 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:28.912888    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:29.000921 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.000886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.001073 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.000944    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.001073 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.000974    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.001073 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.001000    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.001217 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.001084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.001217 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.001145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8g6\" (UniqueName: \"kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.101875 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.101841    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102039 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.101889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102039 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.101908    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102039 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102012    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102237 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102237 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102074    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8g6\" (UniqueName: \"kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102344 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102294    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102344 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102329    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.102436 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.102397    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.104325 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.104302    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.104599 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.104579    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.113383 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.113364    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8g6\" (UniqueName: \"kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.213872 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.213833    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:29.349027 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:29.348874    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:29.351791 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:00:29.351766    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1117be3_53eb_45c5_a098_9edb8059bc8c.slice/crio-294119a55837bcf09a6dc27034cfe9688a2891d147c098469a0519131d444ef9 WatchSource:0}: Error finding container 294119a55837bcf09a6dc27034cfe9688a2891d147c098469a0519131d444ef9: Status 404 returned error can't find the container with id 294119a55837bcf09a6dc27034cfe9688a2891d147c098469a0519131d444ef9
Jul 16 18:00:30.313984 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:30.313945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" event={"ID":"d1117be3-53eb-45c5-a098-9edb8059bc8c","Type":"ContainerStarted","Data":"4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645"}
Jul 16 18:00:30.314354 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:30.313999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" event={"ID":"d1117be3-53eb-45c5-a098-9edb8059bc8c","Type":"ContainerStarted","Data":"294119a55837bcf09a6dc27034cfe9688a2891d147c098469a0519131d444ef9"}
Jul 16 18:00:30.334703 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:30.334634    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" podStartSLOduration=2.334620963 podStartE2EDuration="2.334620963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:30.333543486 +0000 UTC m=+2801.048060196" watchObservedRunningTime="2026-07-16 18:00:30.334620963 +0000 UTC m=+2801.049137637"
Jul 16 18:00:31.214597 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:31.214561    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:39.214572 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:39.214539    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:39.227025 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:39.227001    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:39.361935 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:39.361909    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:45.172742 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.172704    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:45.181686 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:00:45.181653    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 18:00:45.181686 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:00:45.181686 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:00:45.181686 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645" cmd=["/bin/sleep","15"]
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.181702    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" message="" err=<
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:00:45.181713    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main" containerID="cri-o://4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645"
Jul 16 18:00:45.181918 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.181755    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main" containerID="cri-o://4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645" gracePeriod=60
Jul 16 18:00:45.375807 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.375774    2555 generic.go:356] "Generic (PLEG): container finished" podID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerID="4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645" exitCode=0
Jul 16 18:00:45.375931 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.375824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" event={"ID":"d1117be3-53eb-45c5-a098-9edb8059bc8c","Type":"ContainerDied","Data":"4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645"}
Jul 16 18:00:45.427537 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.427479    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:45.530834 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530808    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.530966 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530853    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.530966 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530871    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq8g6\" (UniqueName: \"kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.530966 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530916    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.530966 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530958    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.531162 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.530982    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm\") pod \"d1117be3-53eb-45c5-a098-9edb8059bc8c\" (UID: \"d1117be3-53eb-45c5-a098-9edb8059bc8c\") "
Jul 16 18:00:45.531216 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.531163    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home" (OuterVolumeSpecName: "home") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:00:45.531284 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.531261    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:00:45.531343 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.531298    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:00:45.533062 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.533038    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:00:45.533273 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.533255    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6" (OuterVolumeSpecName: "kube-api-access-vq8g6") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "kube-api-access-vq8g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:00:45.533328 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.533304    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm" (OuterVolumeSpecName: "dshm") pod "d1117be3-53eb-45c5-a098-9edb8059bc8c" (UID: "d1117be3-53eb-45c5-a098-9edb8059bc8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:00:45.631817 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631787    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:45.631817 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631812    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:45.631817 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631821    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:45.631981 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631829    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1117be3-53eb-45c5-a098-9edb8059bc8c-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:45.631981 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631840    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq8g6\" (UniqueName: \"kubernetes.io/projected/d1117be3-53eb-45c5-a098-9edb8059bc8c-kube-api-access-vq8g6\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:45.631981 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:45.631848    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1117be3-53eb-45c5-a098-9edb8059bc8c-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:00:46.352260 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.352222    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.31:8000/health\": context deadline exceeded"
Jul 16 18:00:46.381646 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.381613    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf" event={"ID":"d1117be3-53eb-45c5-a098-9edb8059bc8c","Type":"ContainerDied","Data":"294119a55837bcf09a6dc27034cfe9688a2891d147c098469a0519131d444ef9"}
Jul 16 18:00:46.381646 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.381647    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"
Jul 16 18:00:46.381813 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.381682    2555 scope.go:117] "RemoveContainer" containerID="4f35d2d20a655f845bbc12868975432d3992de03a691b12f48017fbc104c6645"
Jul 16 18:00:46.401118 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.401084    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:46.408794 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:46.408771    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-xj8kf"]
Jul 16 18:00:47.845059 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:00:47.845024    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" path="/var/lib/kubelet/pods/d1117be3-53eb-45c5-a098-9edb8059bc8c/volumes"
Jul 16 18:01:05.625195 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.625156    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:05.625671 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.625490    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main"
Jul 16 18:01:05.625671 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.625502    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main"
Jul 16 18:01:05.625671 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.625563    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1117be3-53eb-45c5-a098-9edb8059bc8c" containerName="main"
Jul 16 18:01:05.628183 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.628163    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.630491 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.630470    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 16 18:01:05.638671 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.638650    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:05.780082 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780045    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.780082 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780083    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.780305 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780131    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.780305 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780198    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.780305 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780253    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.780305 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.780273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvv57\" (UniqueName: \"kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881266 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881266 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881218    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881266 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881236    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881266 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881601 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881601 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881313    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvv57\" (UniqueName: \"kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881703 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881635    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881703 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881670    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.881810 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.881731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.883710 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.883688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.883952 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.883933    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.890723 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.890702    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvv57\" (UniqueName: \"kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:05.939619 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:05.939597    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:06.073815 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:06.073792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:06.075570 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:01:06.075545    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3627a45f_5996_4464_95fa_33738eea7bcc.slice/crio-887b26ec807005624bc1918006737985f9e4dafc20da872116b45a4703816d5e WatchSource:0}: Error finding container 887b26ec807005624bc1918006737985f9e4dafc20da872116b45a4703816d5e: Status 404 returned error can't find the container with id 887b26ec807005624bc1918006737985f9e4dafc20da872116b45a4703816d5e
Jul 16 18:01:06.460862 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:06.460832    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" event={"ID":"3627a45f-5996-4464-95fa-33738eea7bcc","Type":"ContainerStarted","Data":"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"}
Jul 16 18:01:06.461037 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:06.460880    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" event={"ID":"3627a45f-5996-4464-95fa-33738eea7bcc","Type":"ContainerStarted","Data":"887b26ec807005624bc1918006737985f9e4dafc20da872116b45a4703816d5e"}
Jul 16 18:01:06.481206 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:06.481015    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" podStartSLOduration=1.481002677 podStartE2EDuration="1.481002677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:06.480255908 +0000 UTC m=+2837.194772593" watchObservedRunningTime="2026-07-16 18:01:06.481002677 +0000 UTC m=+2837.195519351"
Jul 16 18:01:06.940588 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:06.940515    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:15.940371 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:15.940338    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:15.952799 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:15.952774    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:16.393690 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:16.393656    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:16.516032 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:16.516001    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:16.670442 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:16.670366    2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 18:01:16.670600 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:16.670445    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs podName:3627a45f-5996-4464-95fa-33738eea7bcc nodeName:}" failed. No retries permitted until 2026-07-16 18:01:17.170423252 +0000 UTC m=+2847.884939904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 18:01:17.172963 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:17.172935    2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 18:01:17.173374 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:17.173011    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs podName:3627a45f-5996-4464-95fa-33738eea7bcc nodeName:}" failed. No retries permitted until 2026-07-16 18:01:18.172993915 +0000 UTC m=+2848.887510567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 16 18:01:17.517288 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:17.517247    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 18:01:17.517288 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:01:17.517288 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:01:17.517288 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b" cmd=["/bin/sleep","15"]
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.517303    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" message="" err=<
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:17.517315    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" containerName="main" containerID="cri-o://847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"
Jul 16 18:01:17.517538 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.517359    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" containerName="main" containerID="cri-o://847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b" gracePeriod=60
Jul 16 18:01:17.762870 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.762844    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:17.779006 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.778953    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779006 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.778987    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvv57\" (UniqueName: \"kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779188 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779012    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779188 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779062    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779188 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779086    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779188 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779128    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache\") pod \"3627a45f-5996-4464-95fa-33738eea7bcc\" (UID: \"3627a45f-5996-4464-95fa-33738eea7bcc\") "
Jul 16 18:01:17.779398 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779198    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home" (OuterVolumeSpecName: "home") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:01:17.779398 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779336    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:17.779398 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779334    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:01:17.779532 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.779410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache" (OuterVolumeSpecName: "model-cache") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:01:17.781142 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.781088    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm" (OuterVolumeSpecName: "dshm") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:01:17.781280 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.781258    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:01:17.781335 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.781290    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57" (OuterVolumeSpecName: "kube-api-access-wvv57") pod "3627a45f-5996-4464-95fa-33738eea7bcc" (UID: "3627a45f-5996-4464-95fa-33738eea7bcc"). InnerVolumeSpecName "kube-api-access-wvv57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:01:17.880504 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.880466    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvv57\" (UniqueName: \"kubernetes.io/projected/3627a45f-5996-4464-95fa-33738eea7bcc-kube-api-access-wvv57\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:17.880504 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.880502    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:17.880703 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.880612    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:17.880766 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.880733    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3627a45f-5996-4464-95fa-33738eea7bcc-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:17.880811 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:17.880769    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3627a45f-5996-4464-95fa-33738eea7bcc-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:01:18.513760 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.513725    2555 generic.go:356] "Generic (PLEG): container finished" podID="3627a45f-5996-4464-95fa-33738eea7bcc" containerID="847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b" exitCode=0
Jul 16 18:01:18.514240 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.513770    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"
Jul 16 18:01:18.514240 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.513810    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" event={"ID":"3627a45f-5996-4464-95fa-33738eea7bcc","Type":"ContainerDied","Data":"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"}
Jul 16 18:01:18.514240 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.513871    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm" event={"ID":"3627a45f-5996-4464-95fa-33738eea7bcc","Type":"ContainerDied","Data":"887b26ec807005624bc1918006737985f9e4dafc20da872116b45a4703816d5e"}
Jul 16 18:01:18.514240 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.513906    2555 scope.go:117] "RemoveContainer" containerID="847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"
Jul 16 18:01:18.522726 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.522531    2555 scope.go:117] "RemoveContainer" containerID="847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"
Jul 16 18:01:18.522818 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:01:18.522800    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b\": container with ID starting with 847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b not found: ID does not exist" containerID="847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"
Jul 16 18:01:18.522863 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.522826    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b"} err="failed to get container status \"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b\": rpc error: code = NotFound desc = could not find container \"847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b\": container with ID starting with 847d2245730a013817c07d49108ffc72a5148feb169ffcaee508f2b69e0e1f5b not found: ID does not exist"
Jul 16 18:01:18.533303 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.533284    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:18.540552 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:18.540532    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj4qcm"]
Jul 16 18:01:19.844004 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:19.843972    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" path="/var/lib/kubelet/pods/3627a45f-5996-4464-95fa-33738eea7bcc/volumes"
Jul 16 18:01:23.445546 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.445515    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:01:23.445917 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.445785    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" containerName="main"
Jul 16 18:01:23.445917 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.445796    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" containerName="main"
Jul 16 18:01:23.445917 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.445871    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3627a45f-5996-4464-95fa-33738eea7bcc" containerName="main"
Jul 16 18:01:23.450012 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.449991    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.452924 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.452908    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"autoscale-hpa-deploy-kserve-self-signed-certs\""
Jul 16 18:01:23.462841 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.462817    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:01:23.526934 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.526907    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.527050 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.526936    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.527050 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.526957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ph9\" (UniqueName: \"kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.527050 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.527034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.527180 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.527076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.527180 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.527100    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628504 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628604    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ph9\" (UniqueName: \"kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628959 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628905    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.628959 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628936    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.629067 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.628959    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.631023 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.631002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.631155 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.631084    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.640802 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.640775    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ph9\" (UniqueName: \"kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-f297r\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") " pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.759778 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.759716    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:23.902015 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:23.901992    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:01:23.904222 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:01:23.904192    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecb8a99_05d7_4b94_989e_f7b877648aa5.slice/crio-17ef739d06b92a00b1aa3a3be4041ed79791a24152e236879eca5a0708887260 WatchSource:0}: Error finding container 17ef739d06b92a00b1aa3a3be4041ed79791a24152e236879eca5a0708887260: Status 404 returned error can't find the container with id 17ef739d06b92a00b1aa3a3be4041ed79791a24152e236879eca5a0708887260
Jul 16 18:01:24.538741 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:24.538709    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" event={"ID":"4ecb8a99-05d7-4b94-989e-f7b877648aa5","Type":"ContainerStarted","Data":"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"}
Jul 16 18:01:24.539232 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:24.538765    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" event={"ID":"4ecb8a99-05d7-4b94-989e-f7b877648aa5","Type":"ContainerStarted","Data":"17ef739d06b92a00b1aa3a3be4041ed79791a24152e236879eca5a0708887260"}
Jul 16 18:01:24.560494 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:24.560448    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" podStartSLOduration=1.56043334 podStartE2EDuration="1.56043334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:24.559354522 +0000 UTC m=+2855.273871196" watchObservedRunningTime="2026-07-16 18:01:24.56043334 +0000 UTC m=+2855.274950033"
Jul 16 18:01:24.760529 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:24.760501    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:33.760171 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:33.760137    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:33.772604 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:33.772580    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:01:34.589697 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:01:34.589671    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:03:50.468485 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:03:50.468375    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:03:50.475000 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:03:50.474977    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:07:16.319026 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.318993    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:07:16.322212 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.322196    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.324793 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.324766    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 16 18:07:16.324912 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.324771    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa-dockercfg-wdd7p\""
Jul 16 18:07:16.324912 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.324865    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs\""
Jul 16 18:07:16.335690 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.335669    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:07:16.425975 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.425944    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78tg5\" (UniqueName: \"kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.425975 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.425978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.426224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.426003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.426224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.426087    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527376 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78tg5\" (UniqueName: \"kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527564 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527382    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527564 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527564 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527864 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527846    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.527915 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.527851    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.529945 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.529921    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.540285 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.540264    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78tg5\" (UniqueName: \"kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5\") pod \"llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.632587 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.632521    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:16.785385 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.785355    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:07:16.787040 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:07:16.787010    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8059c964_6e78_4593_9931_50447b661a37.slice/crio-941b6ee5b5e65dc54d0368aa9dc26e51c999a0acda3332f9bc7338a87c360709 WatchSource:0}: Error finding container 941b6ee5b5e65dc54d0368aa9dc26e51c999a0acda3332f9bc7338a87c360709: Status 404 returned error can't find the container with id 941b6ee5b5e65dc54d0368aa9dc26e51c999a0acda3332f9bc7338a87c360709
Jul 16 18:07:16.911224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.911136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerStarted","Data":"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"}
Jul 16 18:07:16.911224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:16.911190    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerStarted","Data":"941b6ee5b5e65dc54d0368aa9dc26e51c999a0acda3332f9bc7338a87c360709"}
Jul 16 18:07:17.917509 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:17.917417    2555 generic.go:356] "Generic (PLEG): container finished" podID="8059c964-6e78-4593-9931-50447b661a37" containerID="323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3" exitCode=0
Jul 16 18:07:17.917509 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:17.917497    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerDied","Data":"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"}
Jul 16 18:07:18.923586 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:18.923547    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerStarted","Data":"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"}
Jul 16 18:07:18.923963 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:18.923688    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:07:18.949338 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:18.949288    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" podStartSLOduration=2.199836563 podStartE2EDuration="2.949272497s" totalImagesPullingTime="0s" totalInitContainerRuntime="749.435934ms" isStatefulPod=false podCreationTimestamp="2026-07-16 18:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:07:18.947701775 +0000 UTC m=+3209.662218460" watchObservedRunningTime="2026-07-16 18:07:18.949272497 +0000 UTC m=+3209.663789171"
Jul 16 18:07:49.929594 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:07:49.929569    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:08:50.495610 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:08:50.495491    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:08:50.501911 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:08:50.501884    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:09:32.003776 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:32.003738    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:09:39.930056 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:39.930015    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 16 18:09:47.025575 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.025532    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="main" containerID="cri-o://798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9" gracePeriod=45
Jul 16 18:09:47.277839 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.277788    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:09:47.315367 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315342    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds\") pod \"8059c964-6e78-4593-9931-50447b661a37\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") "
Jul 16 18:09:47.315508 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315398    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location\") pod \"8059c964-6e78-4593-9931-50447b661a37\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") "
Jul 16 18:09:47.315508 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315439    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78tg5\" (UniqueName: \"kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5\") pod \"8059c964-6e78-4593-9931-50447b661a37\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") "
Jul 16 18:09:47.315508 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315486    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs\") pod \"8059c964-6e78-4593-9931-50447b661a37\" (UID: \"8059c964-6e78-4593-9931-50447b661a37\") "
Jul 16 18:09:47.315668 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315576    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "8059c964-6e78-4593-9931-50447b661a37" (UID: "8059c964-6e78-4593-9931-50447b661a37"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:47.315724 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.315712    2555 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-tokenizer-uds\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:09:47.316156 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.316067    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8059c964-6e78-4593-9931-50447b661a37" (UID: "8059c964-6e78-4593-9931-50447b661a37"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:09:47.317701 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.317672    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8059c964-6e78-4593-9931-50447b661a37" (UID: "8059c964-6e78-4593-9931-50447b661a37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:09:47.317818 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.317702    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5" (OuterVolumeSpecName: "kube-api-access-78tg5") pod "8059c964-6e78-4593-9931-50447b661a37" (UID: "8059c964-6e78-4593-9931-50447b661a37"). InnerVolumeSpecName "kube-api-access-78tg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:09:47.416808 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.416782    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78tg5\" (UniqueName: \"kubernetes.io/projected/8059c964-6e78-4593-9931-50447b661a37-kube-api-access-78tg5\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:09:47.416808 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.416805    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8059c964-6e78-4593-9931-50447b661a37-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:09:47.416960 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.416816    2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8059c964-6e78-4593-9931-50447b661a37-kserve-provision-location\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:09:47.568235 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.568147    2555 generic.go:356] "Generic (PLEG): container finished" podID="8059c964-6e78-4593-9931-50447b661a37" containerID="798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9" exitCode=0
Jul 16 18:09:47.568235 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.568207    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"
Jul 16 18:09:47.568235 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.568215    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerDied","Data":"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"}
Jul 16 18:09:47.568427 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.568296    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx" event={"ID":"8059c964-6e78-4593-9931-50447b661a37","Type":"ContainerDied","Data":"941b6ee5b5e65dc54d0368aa9dc26e51c999a0acda3332f9bc7338a87c360709"}
Jul 16 18:09:47.568427 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.568321    2555 scope.go:117] "RemoveContainer" containerID="798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"
Jul 16 18:09:47.577327 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.577310    2555 scope.go:117] "RemoveContainer" containerID="323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"
Jul 16 18:09:47.585347 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.585331    2555 scope.go:117] "RemoveContainer" containerID="798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"
Jul 16 18:09:47.585589 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:09:47.585574    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9\": container with ID starting with 798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9 not found: ID does not exist" containerID="798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"
Jul 16 18:09:47.585645 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.585597    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9"} err="failed to get container status \"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9\": rpc error: code = NotFound desc = could not find container \"798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9\": container with ID starting with 798b5a41ace9439d1008af451ccfe658f84a02458b66ddd82653b21f2c8a51d9 not found: ID does not exist"
Jul 16 18:09:47.585645 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.585612    2555 scope.go:117] "RemoveContainer" containerID="323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"
Jul 16 18:09:47.585804 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:09:47.585789    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3\": container with ID starting with 323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3 not found: ID does not exist" containerID="323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"
Jul 16 18:09:47.585857 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.585810    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3"} err="failed to get container status \"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3\": rpc error: code = NotFound desc = could not find container \"323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3\": container with ID starting with 323e19011c7a663fcbcb25d88fbf6bcb7d80f1f0694663276aa9a9f357862cb3 not found: ID does not exist"
Jul 16 18:09:47.593836 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.593814    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:09:47.599178 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.599156    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schem8sfx"]
Jul 16 18:09:47.844218 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:47.844148    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8059c964-6e78-4593-9931-50447b661a37" path="/var/lib/kubelet/pods/8059c964-6e78-4593-9931-50447b661a37/volumes"
Jul 16 18:09:56.182273 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182234    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"]
Jul 16 18:09:56.182725 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182670    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="storage-initializer"
Jul 16 18:09:56.182725 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182685    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="storage-initializer"
Jul 16 18:09:56.182725 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182697    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="main"
Jul 16 18:09:56.182725 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182707    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="main"
Jul 16 18:09:56.182852 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.182791    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8059c964-6e78-4593-9931-50447b661a37" containerName="main"
Jul 16 18:09:56.187589 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.187570    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.189917 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.189894    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-d49nw\""
Jul 16 18:09:56.190077 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.189936    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\""
Jul 16 18:09:56.190077 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.189937    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 16 18:09:56.199098 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.199076    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"]
Jul 16 18:09:56.285042 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.285018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.285163 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.285052    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvw2\" (UniqueName: \"kubernetes.io/projected/98d3963f-09e7-4690-aa9e-b998e764b139-kube-api-access-8kvw2\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.285163 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.285077    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98d3963f-09e7-4690-aa9e-b998e764b139-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.285254 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.285162    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386364 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98d3963f-09e7-4690-aa9e-b998e764b139-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386460 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386379    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386460 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386559 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvw2\" (UniqueName: \"kubernetes.io/projected/98d3963f-09e7-4690-aa9e-b998e764b139-kube-api-access-8kvw2\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386863 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386837    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.386863 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.386856    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/98d3963f-09e7-4690-aa9e-b998e764b139-tokenizer-uds\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.388922 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.388903    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98d3963f-09e7-4690-aa9e-b998e764b139-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.395427 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.395408    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvw2\" (UniqueName: \"kubernetes.io/projected/98d3963f-09e7-4690-aa9e-b998e764b139-kube-api-access-8kvw2\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g\" (UID: \"98d3963f-09e7-4690-aa9e-b998e764b139\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.499399 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.499380    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:56.648633 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:56.648601    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"]
Jul 16 18:09:56.650036 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:09:56.650010    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d3963f_09e7_4690_aa9e_b998e764b139.slice/crio-1911bb3bb73b9fc3dc308b371b34b6cc235768a041778ab2c437507489f19136 WatchSource:0}: Error finding container 1911bb3bb73b9fc3dc308b371b34b6cc235768a041778ab2c437507489f19136: Status 404 returned error can't find the container with id 1911bb3bb73b9fc3dc308b371b34b6cc235768a041778ab2c437507489f19136
Jul 16 18:09:57.614330 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:57.614297    2555 generic.go:356] "Generic (PLEG): container finished" podID="98d3963f-09e7-4690-aa9e-b998e764b139" containerID="8746d83f43ceb4c04e599f741b5d851349a09de8b5be0a5a8ecfcf6fd1a8dfbb" exitCode=0
Jul 16 18:09:57.614803 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:57.614374    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g" event={"ID":"98d3963f-09e7-4690-aa9e-b998e764b139","Type":"ContainerDied","Data":"8746d83f43ceb4c04e599f741b5d851349a09de8b5be0a5a8ecfcf6fd1a8dfbb"}
Jul 16 18:09:57.614803 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:57.614429    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g" event={"ID":"98d3963f-09e7-4690-aa9e-b998e764b139","Type":"ContainerStarted","Data":"1911bb3bb73b9fc3dc308b371b34b6cc235768a041778ab2c437507489f19136"}
Jul 16 18:09:58.620396 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:58.620351    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g" event={"ID":"98d3963f-09e7-4690-aa9e-b998e764b139","Type":"ContainerStarted","Data":"6cd9a2c397f091f09d64f1b9cdb626e2549ed3325f76508b17b6f90750b90a9a"}
Jul 16 18:09:58.620794 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:58.620503    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:09:58.645665 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:09:58.645589    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g" podStartSLOduration=1.994269616 podStartE2EDuration="2.645575744s" totalImagesPullingTime="0s" totalInitContainerRuntime="651.306128ms" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:09:58.644145209 +0000 UTC m=+3369.358661898" watchObservedRunningTime="2026-07-16 18:09:58.645575744 +0000 UTC m=+3369.360092420"
Jul 16 18:10:29.626443 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:10:29.626412    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g"
Jul 16 18:13:50.520150 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:13:50.520026    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:13:50.527504 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:13:50.527488    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:16:11.426845 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.426812    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:16:11.436177 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:16:11.436144    2555 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 16 18:16:11.436177 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:16:11.436177 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:16:11.436177 ip-10-0-128-42 kubenswrapper[2555]:  > containerID="0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f" cmd=["/bin/sleep","15"]
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.436190    2555 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" message="" err=<
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:  >
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:16:11.436203    2555 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:         , stdout: , stderr: , exit code -1
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]:  > pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main" containerID="cri-o://0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"
Jul 16 18:16:11.436394 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.436257    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main" containerID="cri-o://0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f" gracePeriod=60
Jul 16 18:16:11.578991 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.578939    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.33:8000/health\": dial tcp 10.132.0.33:8000: connect: connection refused"
Jul 16 18:16:11.683316 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.683261    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:16:11.746182 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746156    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6ph9\" (UniqueName: \"kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746337 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746197    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746337 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746216    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746337 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746235    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746514 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746398    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746514 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746435    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache\") pod \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\" (UID: \"4ecb8a99-05d7-4b94-989e-f7b877648aa5\") "
Jul 16 18:16:11.746514 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746465    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home" (OuterVolumeSpecName: "home") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:16:11.746681 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746643    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:16:11.746733 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746659    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-home\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:11.746733 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.746709    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:16:11.748465 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.748442    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:16:11.748894 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.748874    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm" (OuterVolumeSpecName: "dshm") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:16:11.748894 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.748883    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9" (OuterVolumeSpecName: "kube-api-access-v6ph9") pod "4ecb8a99-05d7-4b94-989e-f7b877648aa5" (UID: "4ecb8a99-05d7-4b94-989e-f7b877648aa5"). InnerVolumeSpecName "kube-api-access-v6ph9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:16:11.847566 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.847528    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tls-certs\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:11.847566 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.847553    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-tmp-dir\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:11.847566 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.847562    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-model-cache\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:11.847566 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.847571    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6ph9\" (UniqueName: \"kubernetes.io/projected/4ecb8a99-05d7-4b94-989e-f7b877648aa5-kube-api-access-v6ph9\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:11.848011 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:11.847579    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ecb8a99-05d7-4b94-989e-f7b877648aa5-dshm\") on node \"ip-10-0-128-42.ec2.internal\" DevicePath \"\""
Jul 16 18:16:12.194124 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.194073    2555 generic.go:356] "Generic (PLEG): container finished" podID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerID="0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f" exitCode=0
Jul 16 18:16:12.194304 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.194148    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"
Jul 16 18:16:12.194304 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.194167    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" event={"ID":"4ecb8a99-05d7-4b94-989e-f7b877648aa5","Type":"ContainerDied","Data":"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"}
Jul 16 18:16:12.194304 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.194232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r" event={"ID":"4ecb8a99-05d7-4b94-989e-f7b877648aa5","Type":"ContainerDied","Data":"17ef739d06b92a00b1aa3a3be4041ed79791a24152e236879eca5a0708887260"}
Jul 16 18:16:12.194304 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.194257    2555 scope.go:117] "RemoveContainer" containerID="0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"
Jul 16 18:16:12.203056 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.203035    2555 scope.go:117] "RemoveContainer" containerID="0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"
Jul 16 18:16:12.203314 ip-10-0-128-42 kubenswrapper[2555]: E0716 18:16:12.203295    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f\": container with ID starting with 0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f not found: ID does not exist" containerID="0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"
Jul 16 18:16:12.203364 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.203322    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f"} err="failed to get container status \"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f\": rpc error: code = NotFound desc = could not find container \"0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f\": container with ID starting with 0ffdb5f3c999da8aa51c13ad4ba84ef4acbe3fccea6f032297d6708951a16e5f not found: ID does not exist"
Jul 16 18:16:12.213592 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.213571    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:16:12.218933 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:12.218916    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/autoscale-hpa-deploy-kserve-66746bd8b9-f297r"]
Jul 16 18:16:13.845188 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:16:13.845158    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" path="/var/lib/kubelet/pods/4ecb8a99-05d7-4b94-989e-f7b877648aa5/volumes"
Jul 16 18:18:50.544548 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:18:50.544431    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:18:50.551880 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:18:50.551862    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:23:50.571412 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:23:50.571309    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:23:50.579059 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:23:50.579038    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xvjmz_0b3f6f96-a7cd-491f-bf43-18f362dc6b11/ovn-acl-logging/0.log"
Jul 16 18:26:18.105555 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:18.105528    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:18.115446 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:18.115421    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:41.344148 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:41.344088    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:41.570931 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:41.570895    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:41.669339 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:41.669264    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:41.687214 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:41.687180    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:41.783646 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:41.783625    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:42.792801 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:42.792776    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:42.959269 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:42.959238    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:43.064364 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:43.064284    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:43.080052 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:43.080022    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:43.192627 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:43.192603    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:44.245162 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:44.245134    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:44.383365 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:44.383340    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:44.454460 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:44.454434    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:44.470050 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:44.470029    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:44.533649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:44.533590    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:45.564524 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:45.564488    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:45.700261 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:45.700231    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:45.774252 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:45.774230    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:45.785224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:45.785205    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:45.850415 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:45.850359    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:46.869346 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:46.869313    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:47.005949 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:47.005924    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:47.083142 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:47.083085    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:47.095872 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:47.095852    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:47.171224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:47.171151    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:48.279033 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:48.278999    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:48.412433 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:48.412406    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:48.493160 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:48.493134    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:48.504773 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:48.504748    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:48.585692 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:48.585626    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:49.661682 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:49.661650    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:49.803942 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:49.803916    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:49.880732 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:49.880697    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:49.894541 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:49.894519    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:49.966901 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:49.966876    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:50.951594 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:50.951569    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:51.088095 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:51.088066    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:51.158346 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:51.158320    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:51.170253 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:51.170226    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:51.234355 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:51.234292    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:52.298540 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:52.298507    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:52.430421 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:52.430379    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:52.504264 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:52.504235    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:52.516247 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:52.516224    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:52.578873 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:52.578784    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:53.605923 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:53.605890    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:53.738584 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:53.738556    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:53.811287 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:53.811262    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:53.824041 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:53.824021    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:53.884479 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:53.884423    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:54.879331 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:54.879304    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:55.018649 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:55.018614    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:55.093713 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:55.093686    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:55.106084 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:55.106058    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:55.169187 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:55.169094    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:56.174100 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:56.174068    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:56.304404 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:56.304376    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:56.378852 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:56.378826    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:56.390876 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:56.390857    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:56.454225 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:56.454203    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:57.449156 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:57.449127    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:57.581548 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:57.581513    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:57.655575 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:57.655546    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:57.667181 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:57.667150    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:57.734195 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:57.734093    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:26:58.761282 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:58.761259    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:26:58.899412 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:58.899385    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:26:58.968993 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:58.968953    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:26:58.981085 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:58.981065    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:26:59.049469 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:26:59.048976    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:27:00.014669 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:00.014640    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-concurrency-test-kserve-b5d44467c-xdjqc_6043697f-08b3-481c-a033-e1b8405f613d/main/0.log"
Jul 16 18:27:00.153982 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:00.153951    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_fc-smoke-test-kserve-router-scheduler-fcbfbd8bf-k8qnk_f3fc5b1f-d31f-41d4-ac8d-c7b4e33eeecb/main/0.log"
Jul 16 18:27:00.228384 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:00.228351    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/main/0.log"
Jul 16 18:27:00.240950 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:00.240913    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schewz48g_98d3963f-09e7-4690-aa9e-b998e764b139/storage-initializer/0.log"
Jul 16 18:27:00.301937 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:00.301821    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche7q2hk_25efbac3-e5a8-4520-8538-a2e5b11b616c/main/0.log"
Jul 16 18:27:06.119653 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:06.119627    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:06.164500 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:06.164479    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:07.178642 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:07.178600    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:07.227451 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:07.227425    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:08.261867 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:08.261840    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:08.303381 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:08.303349    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:09.289255 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:09.289219    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:09.334373 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:09.334347    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:10.284399 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:10.284372    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:10.327664 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:10.327638    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:11.264550 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:11.264521    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:11.304895 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:11.304873    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:12.257600 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:12.257563    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:12.300270 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:12.300244    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:13.278229 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:13.278200    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:13.322701 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:13.322678    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:14.342432 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:14.342404    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:14.382804 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:14.382782    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:15.343962 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:15.343934    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:15.385885 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:15.385861    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:16.384201 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:16.384174    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:16.429153 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:16.429125    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:17.407942 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:17.407913    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:17.460751 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:17.460727    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:18.420825 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:18.420788    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:18.470355 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:18.470333    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:19.424026 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:19.423997    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:19.464908 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:19.464887    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:20.433429 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:20.433394    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:20.485017 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:20.484995    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:21.493065 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:21.493038    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:21.536376 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:21.536355    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:22.487715 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:22.487691    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:22.530340 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:22.530313    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:23.516080 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:23.516034    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:23.560733 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:23.560705    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:24.540511 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:24.540485    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:24.592826 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:24.592804    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:25.533599 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:25.533571    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:25.578186 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:25.578162    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:26.554124 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:26.554081    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:26.595080 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:26.595053    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:27.568522 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:27.568498    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:27.611402 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:27.611377    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:28.600767 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:28.600738    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:28.643183 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:28.643155    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:29.629451 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:29.629419    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:29.672960 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:29.672940    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:30.673742 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:30.673712    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:30.718154 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:30.718132    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:31.764483 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:31.764452    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:31.808547 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:31.808520    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:32.750407 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:32.750375    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:32.799603 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:32.799581    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:33.757761 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:33.757734    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:33.815288 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:33.815266    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:34.824263 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:34.824231    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:34.873798 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:34.873770    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:35.845269 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:35.845242    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:35.895917 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:35.895895    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:36.831028 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:36.831000    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:36.882245 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:36.882222    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:37.933573 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:37.933545    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:38.002416 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:38.002390    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:39.027187 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:39.027152    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:39.086411 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:39.086390    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:40.132482 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:40.132454    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:40.173871 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:40.173844    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:41.165296 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:41.165262    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:41.212292 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:41.212259    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:42.206319 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:42.206290    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:42.252351 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:42.252325    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:43.228505 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:43.228477    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:43.279544 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:43.279518    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:44.241224 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:44.241197    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:44.286234 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:44.286211    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:45.246089 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:45.246062    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:45.287661 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:45.287638    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:46.252955 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:46.252926    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:46.294299 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:46.294276    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:47.299561 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:47.299528    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:47.340239 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:47.340212    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:48.360771 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:48.360747    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:48.403688 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:48.403668    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:49.372193 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:49.372161    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:49.414829 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:49.414808    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:50.389842 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:50.389806    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:50.433352 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:50.433330    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:51.367455 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:51.367424    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:51.408407 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:51.408382    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:52.355141 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:52.355090    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:52.398023 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:52.398001    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:53.433611 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:53.433584    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:53.477734 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:53.477708    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:54.490838 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:54.490806    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:54.529154 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:54.529131    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:55.527814 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:55.527780    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:55.570016 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:55.569990    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:56.595803 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:56.595767    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:56.648930 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:56.648911    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:57.655693 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:57.655627    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:57.696316 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:57.696293    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:58.703386 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:58.703357    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:58.746732 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:58.746712    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:27:59.723451 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:59.723421    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:27:59.771425 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:27:59.771398    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:00.712039 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:00.712010    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:00.760564 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:00.760538    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:01.769962 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:01.769929    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:01.824063 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:01.824036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:02.817583 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:02.817552    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:02.858116 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:02.858085    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:03.860800 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:03.860771    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:03.906271 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:03.906249    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:04.910340 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:04.910310    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:04.954330 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:04.954307    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:05.971934 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:05.971903    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:06.019206 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:06.019180    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:07.067587 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:07.067555    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:07.114421 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:07.114396    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:08.121512 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:08.121482    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:08.166884 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:08.166864    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:10.635183 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.635153    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh77t/must-gather-82ktg"]
Jul 16 18:28:10.635618 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.635430    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main"
Jul 16 18:28:10.635618 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.635441    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main"
Jul 16 18:28:10.635618 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.635524    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ecb8a99-05d7-4b94-989e-f7b877648aa5" containerName="main"
Jul 16 18:28:10.638461 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.638440    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.640717 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.640699    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh77t\"/\"kube-root-ca.crt\""
Jul 16 18:28:10.640911 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.640789    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh77t\"/\"default-dockercfg-m6ppb\""
Jul 16 18:28:10.640911 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.640883    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh77t\"/\"openshift-service-ca.crt\""
Jul 16 18:28:10.647348 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.647328    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh77t/must-gather-82ktg"]
Jul 16 18:28:10.688130 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.688073    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ca8b-f0b7-4105-840b-57debb73bab6-must-gather-output\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.688244 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.688193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxv9w\" (UniqueName: \"kubernetes.io/projected/1dd8ca8b-f0b7-4105-840b-57debb73bab6-kube-api-access-hxv9w\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.789068 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.789036    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ca8b-f0b7-4105-840b-57debb73bab6-must-gather-output\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.789238 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.789090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxv9w\" (UniqueName: \"kubernetes.io/projected/1dd8ca8b-f0b7-4105-840b-57debb73bab6-kube-api-access-hxv9w\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.789386 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.789366    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ca8b-f0b7-4105-840b-57debb73bab6-must-gather-output\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.802854 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.802831    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxv9w\" (UniqueName: \"kubernetes.io/projected/1dd8ca8b-f0b7-4105-840b-57debb73bab6-kube-api-access-hxv9w\") pod \"must-gather-82ktg\" (UID: \"1dd8ca8b-f0b7-4105-840b-57debb73bab6\") " pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:10.947992 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:10.947956    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh77t/must-gather-82ktg"
Jul 16 18:28:11.081894 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:11.081848    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh77t/must-gather-82ktg"]
Jul 16 18:28:11.084216 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:28:11.084189    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd8ca8b_f0b7_4105_840b_57debb73bab6.slice/crio-6d8f99e3f622d818c6bd39868aa02aae2023aa1da8e8aa3c980f494f864047cd WatchSource:0}: Error finding container 6d8f99e3f622d818c6bd39868aa02aae2023aa1da8e8aa3c980f494f864047cd: Status 404 returned error can't find the container with id 6d8f99e3f622d818c6bd39868aa02aae2023aa1da8e8aa3c980f494f864047cd
Jul 16 18:28:11.086479 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:11.086462    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:28:12.032598 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:12.032562    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh77t/must-gather-82ktg" event={"ID":"1dd8ca8b-f0b7-4105-840b-57debb73bab6","Type":"ContainerStarted","Data":"6d8f99e3f622d818c6bd39868aa02aae2023aa1da8e8aa3c980f494f864047cd"}
Jul 16 18:28:14.044532 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.044492    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh77t/must-gather-82ktg" event={"ID":"1dd8ca8b-f0b7-4105-840b-57debb73bab6","Type":"ContainerStarted","Data":"7307167c51fadbbc8c39aca2e76b7c2c4b5999eaae28ebe7575d8cb4dceae2a8"}
Jul 16 18:28:14.045090 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.045065    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh77t/must-gather-82ktg" event={"ID":"1dd8ca8b-f0b7-4105-840b-57debb73bab6","Type":"ContainerStarted","Data":"8cf41014b74ddcef437761474e20be6921e3c8943017417befd0380d985c69a1"}
Jul 16 18:28:14.062733 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.062671    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh77t/must-gather-82ktg" podStartSLOduration=2.145247405 podStartE2EDuration="4.062651549s" totalImagesPullingTime="1.917404144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:28:14.061559071 +0000 UTC m=+4464.776075746" watchObservedRunningTime="2026-07-16 18:28:14.062651549 +0000 UTC m=+4464.777168223"
Jul 16 18:28:14.645401 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.645376    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p4pp7_c0e38676-4590-413a-8a6a-d06077f8aa5d/global-pull-secret-syncer/0.log"
Jul 16 18:28:14.860811 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.860784    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-svjcb_6c7330f2-66f9-47d0-877c-630b88a820c8/konnectivity-agent/0.log"
Jul 16 18:28:14.884691 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:14.884662    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-42.ec2.internal_4706a1e4d7dbe616d691c397a7da5d56/haproxy/0.log"
Jul 16 18:28:20.254730 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:20.254656    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c77957575-xc96s_fa6a1664-1753-41af-a47d-25d5cf8f55da/authorino/0.log"
Jul 16 18:28:20.370235 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:20.370202    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-m6wrp_4e96a427-cdcf-4760-b0fb-6bc4ed5b63f6/kuadrant-console-plugin/0.log"
Jul 16 18:28:22.405871 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:22.405841    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwh9g_65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a/node-exporter/0.log"
Jul 16 18:28:22.433205 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:22.433166    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwh9g_65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a/kube-rbac-proxy/0.log"
Jul 16 18:28:22.469843 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:22.469813    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwh9g_65b8ee3e-6952-4c61-8ea3-4ae84c6dfd6a/init-textfile/0.log"
Jul 16 18:28:24.294586 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.294556    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-tnwtv_63cebda9-6aed-479d-888c-e85cec991785/networking-console-plugin/0.log"
Jul 16 18:28:24.574786 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.574702    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"]
Jul 16 18:28:24.579364 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.579338    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.586431 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.586409    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"]
Jul 16 18:28:24.616443 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.616413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8664j\" (UniqueName: \"kubernetes.io/projected/1509503d-f016-42a4-bb9c-1ceb4ed3607d-kube-api-access-8664j\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.616611 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.616468    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-proc\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.616611 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.616550    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-lib-modules\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.616611 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.616589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-sys\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.616611 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.616611    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-podres\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.717399 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.717367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-proc\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.717667 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.717641    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-proc\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.717858 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.717662    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-lib-modules\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718057 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.717788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-lib-modules\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718200 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.718044    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-sys\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718360 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.718345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-podres\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718496 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.718468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-podres\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718657 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.718181    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1509503d-f016-42a4-bb9c-1ceb4ed3607d-sys\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.718763 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.718513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8664j\" (UniqueName: \"kubernetes.io/projected/1509503d-f016-42a4-bb9c-1ceb4ed3607d-kube-api-access-8664j\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.729518 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.729449    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8664j\" (UniqueName: \"kubernetes.io/projected/1509503d-f016-42a4-bb9c-1ceb4ed3607d-kube-api-access-8664j\") pod \"perf-node-gather-daemonset-vj8kd\" (UID: \"1509503d-f016-42a4-bb9c-1ceb4ed3607d\") " pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:24.894314 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:24.893977    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:25.065798 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:25.065776    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"]
Jul 16 18:28:25.067629 ip-10-0-128-42 kubenswrapper[2555]: W0716 18:28:25.067601    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1509503d_f016_42a4_bb9c_1ceb4ed3607d.slice/crio-ce89c96527b2a87e87853f588442c00ec5d6993ef0927e916db6be69a7649186 WatchSource:0}: Error finding container ce89c96527b2a87e87853f588442c00ec5d6993ef0927e916db6be69a7649186: Status 404 returned error can't find the container with id ce89c96527b2a87e87853f588442c00ec5d6993ef0927e916db6be69a7649186
Jul 16 18:28:25.109325 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:25.109297    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd" event={"ID":"1509503d-f016-42a4-bb9c-1ceb4ed3607d","Type":"ContainerStarted","Data":"ce89c96527b2a87e87853f588442c00ec5d6993ef0927e916db6be69a7649186"}
Jul 16 18:28:26.116764 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:26.116726    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd" event={"ID":"1509503d-f016-42a4-bb9c-1ceb4ed3607d","Type":"ContainerStarted","Data":"c11ab2b44bc86c9beee59180610894f7d86b5083631bf81a4342223bfe358581"}
Jul 16 18:28:26.117344 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:26.116818    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:26.134650 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:26.134599    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd" podStartSLOduration=2.134583406 podStartE2EDuration="2.134583406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:28:26.133340371 +0000 UTC m=+4476.847857076" watchObservedRunningTime="2026-07-16 18:28:26.134583406 +0000 UTC m=+4476.849100079"
Jul 16 18:28:27.280935 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:27.280908    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5dwz7_d034936d-7f0d-40b5-a4d9-4b43f6222d3c/dns/0.log"
Jul 16 18:28:27.306593 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:27.306562    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5dwz7_d034936d-7f0d-40b5-a4d9-4b43f6222d3c/kube-rbac-proxy/0.log"
Jul 16 18:28:27.418258 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:27.418227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw9wb_68ae846b-e55f-46e5-bd3d-3f5b29a1a7d7/dns-node-resolver/0.log"
Jul 16 18:28:28.056943 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:28.056917    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cmsm5_0a560d8c-d4ff-40c6-8b71-cf3969fdd3a9/node-ca/0.log"
Jul 16 18:28:30.294802 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:30.294777    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dr8gm_16a677d7-0578-462c-87dc-85668e7965a0/serve-healthcheck-canary/0.log"
Jul 16 18:28:31.007562 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:31.007533    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfl4p_65ebeec5-b68e-4f83-b7d3-e8f2244a0982/kube-rbac-proxy/0.log"
Jul 16 18:28:31.036288 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:31.036265    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfl4p_65ebeec5-b68e-4f83-b7d3-e8f2244a0982/exporter/0.log"
Jul 16 18:28:31.079427 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:31.079396    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfl4p_65ebeec5-b68e-4f83-b7d3-e8f2244a0982/extractor/0.log"
Jul 16 18:28:32.134533 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:32.134495    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh77t/perf-node-gather-daemonset-vj8kd"
Jul 16 18:28:34.684722 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:34.684692    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-558b5fdc8c-7458b_641b00d6-b871-4cee-a2ff-946d1ea1f3e0/manager/0.log"
Jul 16 18:28:34.748307 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:34.748271    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dl9mp_31f9a425-4bc2-4f6d-aa10-91bbf2bccaba/openshift-lws-operator/0.log"
Jul 16 18:28:36.227969 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:36.227946    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-54lxp_9e4ff1a7-ea61-4396-bb09-5a000462c20f/s3-init/0.log"
Jul 16 18:28:36.270648 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:36.270614    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-54lxp_9e4ff1a7-ea61-4396-bb09-5a000462c20f/download-hf-model/0.log"
Jul 16 18:28:36.306476 ip-10-0-128-42 kubenswrapper[2555]: I0716 18:28:36.306428    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-bqk2x_9cd031a3-9511-40ae-b54d-3e174e6fb546/seaweedfs/0.log"