Jul 23 15:50:18.753848 ip-10-0-130-166 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 15:50:19.165951 ip-10-0-130-166 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:19.165951 ip-10-0-130-166 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 15:50:19.165951 ip-10-0-130-166 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:19.165951 ip-10-0-130-166 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 15:50:19.165951 ip-10-0-130-166 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:19.167084 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.166949    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 15:50:19.171976 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171958    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.171976 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171977    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171982    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171985    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171989    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171992    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171995    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.171999    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172002    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172005    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172008    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172011    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172013    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172016    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172024    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172027    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172030    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172033    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172035    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172038    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172041    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.172040 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172043    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172046    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172049    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172052    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172055    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172057    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172060    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172062    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172065    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172067    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172070    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172073    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172075    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172078    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172080    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172083    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172085    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172088    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172090    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172092    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.172504 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172095    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172097    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172100    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172102    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172105    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172107    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172113    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172116    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172119    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172122    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172124    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172127    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172131    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172134    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172138    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172141    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172144    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172146    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172149    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.173178 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172151    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172154    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172156    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172159    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172162    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172165    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172167    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172169    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172172    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172175    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172177    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172180    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172182    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172186    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172188    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172191    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172193    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172196    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172198    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.173867 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172201    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172204    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172207    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172210    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172213    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172215    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172218    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172220    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172224    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172227    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172229    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172232    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172234    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172236    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172239    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172242    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172244    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172247    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172249    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.172252    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.174354 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174199    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174214    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174217    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174220    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174224    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174227    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174230    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174233    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174236    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174239    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174241    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174244    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174247    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174250    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174263    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174267    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174271    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174273    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174276    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.174878 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174279    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174282    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174285    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174287    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174290    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174292    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174296    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174300    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174303    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174306    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174308    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174311    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174314    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174326    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174330    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174333    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174335    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174338    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174342    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.175361 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174348    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174350    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174353    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174356    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174360    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174363    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174366    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174370    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174374    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174377    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174380    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174383    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174387    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174389    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174392    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174395    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174398    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174401    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174403    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.175850 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174406    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174408    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174411    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174414    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174416    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174419    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174422    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174425    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174427    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174430    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174432    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174435    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174438    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174440    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174443    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174445    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174448    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174450    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174453    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174455    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.176298 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174458    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174460    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174463    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174465    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174469    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174471    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174475    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174478    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174480    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174483    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174486    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174489    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174491    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174494    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174496    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174499    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174501    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174504    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174507    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174509    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174511    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.176799 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174514    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.174997    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175004    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175008    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175011    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175014    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175017    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175020    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175023    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175026    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175030    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175034    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175037    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175040    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175043    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175046    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175049    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175052    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175055    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175058    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.177302 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175060    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175062    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175065    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175067    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175070    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175073    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175075    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175078    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175081    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175083    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175086    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175089    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175091    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175094    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175098    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175100    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175103    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175105    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175108    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175111    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.177779 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175113    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175115    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175118    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175120    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175123    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175125    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175128    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175130    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175132    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175135    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175138    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175142    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175145    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175148    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175150    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175153    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175155    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175158    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175160    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.178244 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175163    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175166    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175168    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175171    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175173    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175176    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175178    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175180    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175183    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175186    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175188    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175191    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175193    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175195    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175198    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175200    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175203    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175205    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175207    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.178725 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175210    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175212    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175217    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175220    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175223    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175226    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175229    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175232    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175235    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175238    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175240    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175242    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175245    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175248    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175251    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175253    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175256    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175258    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175261    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175264    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.179155 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175266    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.175269    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175339    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175347    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175354    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175358    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175362    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175366    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175370    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175374    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175378    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175381    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175384    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175387    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175390    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175393    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175396    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175399    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175403    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175406    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175411    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175414    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175419    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175422    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 15:50:19.179651 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175425    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175430    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175433    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175436    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175439    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175442    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175445    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175448    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175451    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175454    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175460    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175464    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175466    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175469    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175472    2574 flags.go:64] FLAG: --enable-server="true"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175475    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175479    2574 flags.go:64] FLAG: --event-burst="100"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175482    2574 flags.go:64] FLAG: --event-qps="50"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175485    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175488    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175491    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175494    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175498    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175500    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175503    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 23 15:50:19.180205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175508    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175511    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175514    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175517    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175533    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175537    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175540    2574 flags.go:64] FLAG: --feature-gates=""
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175544    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175547    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175550    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175553    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175556    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175559    2574 flags.go:64] FLAG: --help="false"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175562    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175566    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175570    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175575    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175582    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175585    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175588    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175591    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175594    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175597    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 15:50:19.180825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175600    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175603    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175606    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175609    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175612    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175615    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175618    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175620    2574 flags.go:64] FLAG: --lock-file=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175623    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175627    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175630    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175636    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175639    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175643    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175645    2574 flags.go:64] FLAG: --logging-format="text"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175648    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175651    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175654    2574 flags.go:64] FLAG: --manifest-url=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175657    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175666    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175669    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175673    2574 flags.go:64] FLAG: --max-pods="110"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175676    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175679    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175682    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 15:50:19.181395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175685    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175689    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175692    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175695    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175702    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175705    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175708    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175711    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175714    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175720    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175722    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175725    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175729    2574 flags.go:64] FLAG: --port="10250"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175732    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175734    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca888374b3b66338"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175738    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175740    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175745    2574 flags.go:64] FLAG: --register-node="true"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175748    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175752    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175755    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175758    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175761    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175764    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175768    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 15:50:19.182369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175771    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175774    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175776    2574 flags.go:64] FLAG: --runonce="false"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175779    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175782    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175784    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175787    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175790    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175795    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175798    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175801    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175804    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175808    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175810    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175813    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175816    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175819    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175822    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175827    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175830    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175832    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175837    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175840    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175843    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175847    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 15:50:19.183429 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175849    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175852    2574 flags.go:64] FLAG: --v="2"
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175857    2574 flags.go:64] FLAG: --version="false"
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175862    2574 flags.go:64] FLAG: --vmodule=""
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175866    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.175869    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176007    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176011    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176014    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176017    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176020    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176022    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176025    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176027    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176030    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176034    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176036    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176039    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176042    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176044    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176046    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.184548 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176049    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176053    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176057    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176060    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176063    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176066    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176069    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176071    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176074    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176076    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176081    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176084    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176086    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176089    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176092    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176096    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176099    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176102    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176104    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.185438 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176107    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176110    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176112    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176115    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176117    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176119    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176122    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176125    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176128    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176131    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176134    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176136    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176139    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176141    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176144    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176146    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176149    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176151    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176154    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176157    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.186205 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176159    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176161    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176165    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176169    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176171    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176174    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176177    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176179    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176182    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176185    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176188    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176192    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176195    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176198    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176201    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176204    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176207    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176209    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176212    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176216    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.186786 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176219    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176221    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176223    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176226    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176228    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176231    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176234    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176236    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176239    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176241    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176245    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176247    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176249    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176252    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176254    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176258    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176261    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176263    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176266    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176269    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.187614 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176271    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176274    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176280    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176282    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.176285    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.176290    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.184305    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.184332    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.184361    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.184371    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184484    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184493    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184499    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184504    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.188391 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184508    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184513    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184534    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184539    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184543    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184547    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184551    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184555    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184559    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184563    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184567    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184571    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184576    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184580    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184587    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184594    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184600    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184604    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184609    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184613    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.188780 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184618    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184622    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184626    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184630    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184634    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184642    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184646    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184651    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184655    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184659    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184664    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184668    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184675    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184680    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184685    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184690    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184695    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184701    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184707    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.189389 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184712    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184716    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184722    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184727    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184731    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184736    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184740    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184744    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184748    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184752    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184756    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184760    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184765    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184769    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184774    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184778    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184782    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184786    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184791    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184797    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.189884 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184802    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184807    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184811    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184815    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184819    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184823    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184827    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184831    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184835    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184840    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184844    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184849    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184853    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184858    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184862    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184866    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184870    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184875    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184879    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184883    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.190436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184887    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184892    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184896    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184900    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184904    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184908    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184913    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184917    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184922    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184927    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184932    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184936    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184941    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184945    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184950    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.190928 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.184954    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.184962    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185153    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185160    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185165    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185170    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185174    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185179    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185183    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185187    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185192    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185197    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185201    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185205    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185209    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:19.191286 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185213    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185217    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185221    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185225    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185230    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185234    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185238    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185243    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185247    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185252    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185256    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185260    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185264    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185269    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185273    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185278    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185282    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185287    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185290    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185295    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:19.191895 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185299    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185303    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185307    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185311    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185315    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185319    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185325    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185332    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185336    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185341    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185345    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185349    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185353    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185357    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185361    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185366    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185370    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185374    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185379    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185383    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:19.192365 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185387    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185391    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185395    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185402    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185407    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185412    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185417    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185421    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185427    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185431    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185435    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185439    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185443    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185447    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185451    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185455    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185459    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185464    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185468    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185473    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:19.192902 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185477    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185481    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185488    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185493    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185498    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185503    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185507    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185512    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185535    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185540    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185544    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185548    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185553    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185557    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185561    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185565    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185569    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185574    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185578    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:19.193387 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185582    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185586    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185591    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185596    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185600    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185605    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:19.185609    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.185617    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.185820    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.188922    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.190302    2574 server.go:1019] "Starting client certificate rotation"
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.190443    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.190515    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:50:19.193846 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.193485    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:50:19.195065 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.195048    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:50:19.207899 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.207874    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 23 15:50:19.210132 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.210111    2574 log.go:25] "Validated CRI v1 image API"
Jul 23 15:50:19.210942 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.210916    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 15:50:19.213903 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.213881    2574 fs.go:135] Filesystem UUIDs: map[4eb870df-0c9c-4336-8d3c-96f2fa1de326:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c1965e42-c520-4be9-b11d-437237ad43a5:/dev/nvme0n1p3]
Jul 23 15:50:19.213982 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.213902    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 15:50:19.219189 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.219058    2574 manager.go:216] Machine: {Timestamp:2026-07-23 15:50:19.218570285 +0000 UTC m=+0.341996052 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099842 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e579dee32181f1ef64093202655eb SystemUUID:ec2e579d-ee32-181f-1ef6-4093202655eb BootID:0bb2f683-6636-4ead-bb3d-e719587867bf Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:e7:d3:eb:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:e7:d3:eb:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:76:aa:6d:fd:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 15:50:19.219189 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.219174    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 15:50:19.219349 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.219256    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 15:50:19.222181 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.222154    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 15:50:19.222346 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.222186    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 15:50:19.222986 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.222974    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 15:50:19.223018 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.222990    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 15:50:19.223018 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.222998    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:50:19.223732 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.223721    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:50:19.225171 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.225158    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 15:50:19.225285 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.225268    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:50:19.228287 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228274    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:50:19.228430 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228421    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 15:50:19.228460 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228454    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 15:50:19.228496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228463    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 15:50:19.228496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228483    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 15:50:19.228496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228493    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 23 15:50:19.228594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228502    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 15:50:19.228944 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228919    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:50:19.228944 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.228938    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:50:19.231198 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.231175    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 15:50:19.233037 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.233024    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 15:50:19.233076 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.233055    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 15:50:19.234246 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234233    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234252    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234268    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234273    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234282    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234288    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234297    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234302    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 15:50:19.234305 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234308    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 15:50:19.234607 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234314    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 15:50:19.234607 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234323    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 15:50:19.234607 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234329    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 15:50:19.234607 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234357    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 15:50:19.234607 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.234363    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 15:50:19.237962 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.237948    2574 server.go:1268] "Started kubelet"
Jul 23 15:50:19.238129 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.238065    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 15:50:19.238197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.238039    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 15:50:19.238197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.238161    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 15:50:19.238851 ip-10-0-130-166 systemd[1]: Started Kubernetes Kubelet.
Jul 23 15:50:19.241904 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.241877    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 15:50:19.243153 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.242845    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 15:50:19.244772 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.244664    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 15:50:19.244772 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.244739    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 15:50:19.244772 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.244735    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 15:50:19.245206 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.245187    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 15:50:19.245658 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.244656    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-166.ec2.internal.18c4f5fcfb0adf94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-166.ec2.internal,UID:ip-10-0-130-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-166.ec2.internal,},FirstTimestamp:2026-07-23 15:50:19.237916564 +0000 UTC m=+0.361342389,LastTimestamp:2026-07-23 15:50:19.237916564 +0000 UTC m=+0.361342389,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-166.ec2.internal,}"
Jul 23 15:50:19.248977 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.248962    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 15:50:19.248977 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.248971    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 15:50:19.249113 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.249093    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.249659 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249644    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 15:50:19.249768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249659    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 15:50:19.249768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249673    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 15:50:19.249863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249774    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 15:50:19.249863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249782    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 15:50:19.250029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249953    2574 factory.go:55] Registering systemd factory
Jul 23 15:50:19.250029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.249968    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 23 15:50:19.250183 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250158    2574 factory.go:153] Registering CRI-O factory
Jul 23 15:50:19.250183 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250176    2574 factory.go:223] Registration of the crio container factory successfully
Jul 23 15:50:19.250286 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250228    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 15:50:19.250286 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250249    2574 factory.go:103] Registering Raw factory
Jul 23 15:50:19.250286 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250272    2574 manager.go:1196] Started watching for new ooms in manager
Jul 23 15:50:19.250986 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.250973    2574 manager.go:349] Starting recovery of all containers
Jul 23 15:50:19.251579 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.251545    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 15:50:19.251688 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.251665    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 15:50:19.261937 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.261780    2574 manager.go:354] Recovery completed
Jul 23 15:50:19.263282 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.263255    2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 23 15:50:19.266332 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.266314    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.267036 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.267019    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmvsn"
Jul 23 15:50:19.268380 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.268359    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.268463 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.268400    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.268463 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.268415    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.269432 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.269416    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 15:50:19.269432 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.269427    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 15:50:19.269432 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.269431    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.269602 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.269445    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:50:19.270270 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270243    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.270350 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270291    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.270350 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270304    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.270945 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270929    2574 policy_none.go:49] "None policy: Start"
Jul 23 15:50:19.271008 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270950    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 15:50:19.271008 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.270964    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 15:50:19.272209 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.272197    2574 policy_none.go:47] "Start"
Jul 23 15:50:19.275817 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.275789    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmvsn"
Jul 23 15:50:19.277988 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.277916    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-166.ec2.internal.18c4f5fcfcdbb418  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-166.ec2.internal,UID:ip-10-0-130-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-166.ec2.internal,},FirstTimestamp:2026-07-23 15:50:19.268379672 +0000 UTC m=+0.391805439,LastTimestamp:2026-07-23 15:50:19.268379672 +0000 UTC m=+0.391805439,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-166.ec2.internal,}"
Jul 23 15:50:19.319238 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319214    2574 manager.go:337] "Starting Device Plugin manager"
Jul 23 15:50:19.319395 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.319254    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 15:50:19.319395 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319265    2574 server.go:87] "Starting device plugin registration server"
Jul 23 15:50:19.319617 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319603    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 15:50:19.319698 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319618    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 15:50:19.319841 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319806    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 15:50:19.319924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319910    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 15:50:19.319924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.319923    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 15:50:19.320576 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.320552    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 15:50:19.320671 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.320615    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.386466 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.386425    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 15:50:19.387885 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.387592    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 15:50:19.387885 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.387629    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 15:50:19.387885 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.387654    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 15:50:19.387885 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.387688    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 15:50:19.390178 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.390154    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:19.420273 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.420207    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.421278 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.421253    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.421398 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.421286    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.421398 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.421300    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.421398 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.421326    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.429971 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.429944    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.429971 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.429974    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-166.ec2.internal\": node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.447696 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.447665    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.488468 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.488435    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"]
Jul 23 15:50:19.488666 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.488509    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.490318 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.490299    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.490412 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.490332    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.490412 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.490342    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.492135 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492123    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.492259 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.492298 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492281    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.492941 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492926    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.493020 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492953    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.493020 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492962    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.493020 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.492927    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.493122 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.493024    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.493122 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.493034    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.494566 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.494548    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.494629 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.494584    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:19.495352 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.495334    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:19.495452 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.495366    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:19.495452 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.495379    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:19.509141 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.509114    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-166.ec2.internal\" not found" node="ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.513116 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.513097    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-166.ec2.internal\" not found" node="ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.548425 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.548394    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.552422 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.552389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.552422 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.552419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.552585 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.552440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.649013 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.648978    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.652839 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.652925 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.652925 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652867    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.652925 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4f18a4042ac0c4f669794ed57bc7586-config\") pod \"kube-apiserver-proxy-ip-10-0-130-166.ec2.internal\" (UID: \"a4f18a4042ac0c4f669794ed57bc7586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.653044 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.653044 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.652939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa81fefd8cb9506ed41c32bd7a3ab6b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal\" (UID: \"fa81fefd8cb9506ed41c32bd7a3ab6b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.750132 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.750043    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.813403 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.813375    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.816254 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:19.816213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:19.851148 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.851103    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:19.951693 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:19.951643    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:20.052196 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:20.052126    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:20.066734 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.066712    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:20.153195 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:20.153148    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:20.189479 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.189455    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 15:50:20.189953 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.189609    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:50:20.189953 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.189652    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:50:20.253444 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:20.253412    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:20.280336 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.280288    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 15:45:19 +0000 UTC" deadline="2027-12-16 19:21:34.304998181 +0000 UTC"
Jul 23 15:50:20.280470 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.280338    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12267h31m14.024678251s"
Jul 23 15:50:20.353954 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:20.353875    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-166.ec2.internal\" not found"
Jul 23 15:50:20.385750 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:20.385712    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f18a4042ac0c4f669794ed57bc7586.slice/crio-9c7691df30d23f95da5a63a82c0ff1c6241eec657f73decd98025df0a47a18a7 WatchSource:0}: Error finding container 9c7691df30d23f95da5a63a82c0ff1c6241eec657f73decd98025df0a47a18a7: Status 404 returned error can't find the container with id 9c7691df30d23f95da5a63a82c0ff1c6241eec657f73decd98025df0a47a18a7
Jul 23 15:50:20.386609 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:20.386573    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa81fefd8cb9506ed41c32bd7a3ab6b4.slice/crio-99082a9ec448f58de469fc53ce5b52db3fbcdb8ddd4b33bd67d61db1cef24bb3 WatchSource:0}: Error finding container 99082a9ec448f58de469fc53ce5b52db3fbcdb8ddd4b33bd67d61db1cef24bb3: Status 404 returned error can't find the container with id 99082a9ec448f58de469fc53ce5b52db3fbcdb8ddd4b33bd67d61db1cef24bb3
Jul 23 15:50:20.392119 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.392092    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:50:20.409420 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.409394    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:20.450127 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.450091    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:20.462250 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.462224    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:50:20.464686 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.464669    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal"
Jul 23 15:50:20.476153 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.476129    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:50:20.629159 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:20.629083    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:21.156537 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.156493    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:21.229370 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.229329    2574 apiserver.go:52] "Watching apiserver"
Jul 23 15:50:21.238876 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.238843    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 15:50:21.240096 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.240059    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qlbc8","kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal","openshift-multus/multus-additional-cni-plugins-5r9pt","openshift-network-diagnostics/network-check-target-vjkjv","openshift-network-operator/iptables-alerter-nr8dh","openshift-ovn-kubernetes/ovnkube-node-nw9cp","kube-system/global-pull-secret-syncer-jw7tl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4","openshift-cluster-node-tuning-operator/tuned-zw975","openshift-dns/node-resolver-8vhn5","openshift-image-registry/node-ca-sdcvj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal","openshift-multus/multus-t9jwr","openshift-multus/network-metrics-daemon-2t5t4"]
Jul 23 15:50:21.242051 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.241965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.242188 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.242048    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:21.243265 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.243041    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.244369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.244347    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.245705 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.245584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:21.245705 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.245660    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246385    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246555    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7jtb\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246635    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246701    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246793    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246823    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 15:50:21.246949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246845    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8mfh4\""
Jul 23 15:50:21.247321 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.246976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 15:50:21.247321 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.247233    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.249023 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.249004    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.249228 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.249210    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 15:50:21.250991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.250604    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.250991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.250738    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z2ndl\""
Jul 23 15:50:21.250991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.250778    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.250991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.250852    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 15:50:21.250991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.250875    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.251834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.251636    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nsthw\""
Jul 23 15:50:21.251834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.251683    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 15:50:21.251834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.251704    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 15:50:21.251834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.251711    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 15:50:21.252191 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.252029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.252763 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.252744    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 15:50:21.252847 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.252834    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.253131 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.253113    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.253200 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.253175    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.253419 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.253402    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.253484 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.253462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.253560 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.253537    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:21.253620 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.253408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-569r9\""
Jul 23 15:50:21.254452 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.254437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 15:50:21.254554 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.254497    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 15:50:21.254924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.254905    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-92z6n\""
Jul 23 15:50:21.255446 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.255431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.257148 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.257128    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.257726 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.257706    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.257820 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.257726    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8dfn9\""
Jul 23 15:50:21.257879 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.257715    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.258548 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.258513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.259452 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.259431    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.259549 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.259454    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.259849 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.259832    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 15:50:21.259849 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.259848    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmdl4\""
Jul 23 15:50:21.261100 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.260802    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 15:50:21.261100 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.261091    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 15:50:21.261236 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.261128    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zzrj\""
Jul 23 15:50:21.261236 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.261146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 15:50:21.264158 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-tmp\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264253 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-lib-modules\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264253 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-kubelet\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264253 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-env-overrides\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264402 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-multus-certs\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264402 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-bin\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264402 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264402 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-conf\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-kubelet-config\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-multus\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfzh\" (UniqueName: \"kubernetes.io/projected/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-kube-api-access-zkfzh\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:21.264618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-kubernetes\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-systemd\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-netns\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovn-node-metrics-cert\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cnibin\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264748    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-host\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-hostroot\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-run\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-socket-dir-parent\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-k8s-cni-cncf-io\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-netns\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.264930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-systemd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-etc-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.264996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-os-release\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-modprobe-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8xl\" (UniqueName: \"kubernetes.io/projected/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-kube-api-access-4n8xl\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-system-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-log-socket\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-system-cni-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8cb\" (UniqueName: \"kubernetes.io/projected/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-kube-api-access-9c8cb\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-script-lib\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265283    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cnibin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-os-release\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-ovn\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.265439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-tuned\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.266090 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.265815    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:50:21.266756 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-kubelet\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.266843 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d201ed1a-b122-45bd-96bd-c42ce7cd66da-iptables-alerter-script\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.266843 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.266939 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.266939 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-etc-kubernetes\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.266939 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267075 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-netd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267075 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.266976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-config\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267075 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-sys\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.267075 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-daemon-config\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.267243 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-slash\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267243 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-node-log\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267243 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267243 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-conf-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kwl\" (UniqueName: \"kubernetes.io/projected/d201ed1a-b122-45bd-96bd-c42ce7cd66da-kube-api-access-p2kwl\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267284    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-dbus\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysconfig\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-var-lib-kubelet\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4895\" (UniqueName: \"kubernetes.io/projected/9105896e-c049-41a2-86fd-26c2d48cf42e-kube-api-access-m4895\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.267416 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cni-binary-copy\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.267768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-bin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.267768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d201ed1a-b122-45bd-96bd-c42ce7cd66da-host-slash\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.267768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-systemd-units\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.267768 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.267632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-var-lib-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.285747 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.285586    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmscg"
Jul 23 15:50:21.296744 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.296715    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmscg"
Jul 23 15:50:21.350599 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.350545    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 15:50:21.368417 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df8d355f-b264-4118-8a8d-f6000315b61f-hosts-file\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.368417 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-systemd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-etc-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368471    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-os-release\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-modprobe-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-systemd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368533    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-etc-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8xl\" (UniqueName: \"kubernetes.io/projected/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-kube-api-access-4n8xl\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368613    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-os-release\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-system-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.368692 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.368650    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.368721    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:21.868694717 +0000 UTC m=+2.992120476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-modprobe-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-log-socket\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368751    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-host\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-device-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-system-cni-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-log-socket\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-system-cni-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8cb\" (UniqueName: \"kubernetes.io/projected/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-kube-api-access-9c8cb\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-script-lib\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cnibin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.368964    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-system-cni-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.369260 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-os-release\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-ovn\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369062    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cnibin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-tuned\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369077    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-os-release\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-kubelet\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-ovn\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d201ed1a-b122-45bd-96bd-c42ce7cd66da-iptables-alerter-script\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-kubelet\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-etc-kubernetes\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-netd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-config\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-sys\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.369991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-daemon-config\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-slash\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369473    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-run-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369499    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-netd\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-node-log\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-script-lib\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-etc-kubernetes\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369800    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d201ed1a-b122-45bd-96bd-c42ce7cd66da-iptables-alerter-script\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-node-log\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-serviceca\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-conf-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kwl\" (UniqueName: \"kubernetes.io/projected/d201ed1a-b122-45bd-96bd-c42ce7cd66da-kube-api-access-p2kwl\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-dbus\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.369997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysconfig\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-var-lib-kubelet\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4895\" (UniqueName: \"kubernetes.io/projected/9105896e-c049-41a2-86fd-26c2d48cf42e-kube-api-access-m4895\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.370516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cni-binary-copy\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7v9\" (UniqueName: \"kubernetes.io/projected/df8d355f-b264-4118-8a8d-f6000315b61f-kube-api-access-zh7v9\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovnkube-config\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-sys\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-conf-dir\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-var-lib-kubelet\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370246    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysconfig\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-dbus\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-bin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d201ed1a-b122-45bd-96bd-c42ce7cd66da-host-slash\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-systemd-units\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-var-lib-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-tmp\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d201ed1a-b122-45bd-96bd-c42ce7cd66da-host-slash\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83410180-155f-4b82-ae5c-3d26d679a145-konnectivity-ca\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-systemd-units\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371066 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-lib-modules\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-kubelet\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-slash\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-env-overrides\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-var-lib-openvswitch\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgp8\" (UniqueName: \"kubernetes.io/projected/5daf9190-4726-4582-96a6-97c593d0aa80-kube-api-access-zrgp8\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-multus-certs\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-bin\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-daemon-config\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370499    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-bin\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-conf\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-cni-bin\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-kubelet-config\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-multus\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.371591 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-multus-certs\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-lib-modules\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370845    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-ovn-kubernetes\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfzh\" (UniqueName: \"kubernetes.io/projected/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-kube-api-access-zkfzh\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-env-overrides\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83410180-155f-4b82-ae5c-3d26d679a145-agent-certs\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t4hj\" (UniqueName: \"kubernetes.io/projected/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-kube-api-access-9t4hj\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.370996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-cni-binary-copy\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-conf\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-kubernetes\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-kubelet\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371059    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-var-lib-cni-multus\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371131    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-sysctl-d\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.372448 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371186    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-kubernetes\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371199    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-systemd\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371206    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b279901-b871-4d03-bb9e-bc748a79447d-kubelet-config\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-netns\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovn-node-metrics-cert\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371281    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8d355f-b264-4118-8a8d-f6000315b61f-tmp-dir\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-systemd\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-host-run-netns\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cnibin\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-host\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-hostroot\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-run\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cnibin\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371456    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-host\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-socket-dir-parent\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.373909 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-hostroot\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371540    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-k8s-cni-cncf-io\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-netns\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9105896e-c049-41a2-86fd-26c2d48cf42e-run\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcppk\" (UniqueName: \"kubernetes.io/projected/81b71535-fc29-44c1-a128-1b781e38b209-kube-api-access-gcppk\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-multus-socket-dir-parent\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-netns\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-host-run-k8s-cni-cncf-io\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.371942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-cni-binary-copy\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.373293    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-etc-tuned\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.373699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105896e-c049-41a2-86fd-26c2d48cf42e-tmp\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.374862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.373817    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-ovn-node-metrics-cert\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.378218 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.378181    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:21.378218 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.378214    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:21.378572 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.378229    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:21.378572 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.378309    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:21.878289628 +0000 UTC m=+3.001715397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:21.378971 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.378907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8cb\" (UniqueName: \"kubernetes.io/projected/a80322fc-74e7-4ffb-8e51-3333c3bd9d9f-kube-api-access-9c8cb\") pod \"multus-t9jwr\" (UID: \"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f\") " pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.379458 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.379238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8xl\" (UniqueName: \"kubernetes.io/projected/4a26b29a-0e7f-4c06-b381-db0f6eb8a7be-kube-api-access-4n8xl\") pod \"ovnkube-node-nw9cp\" (UID: \"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be\") " pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.379575 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.379485    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4895\" (UniqueName: \"kubernetes.io/projected/9105896e-c049-41a2-86fd-26c2d48cf42e-kube-api-access-m4895\") pod \"tuned-zw975\" (UID: \"9105896e-c049-41a2-86fd-26c2d48cf42e\") " pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.380940 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.380891    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfzh\" (UniqueName: \"kubernetes.io/projected/e0c9d05a-e1ac-4222-ad57-ff1f57efec57-kube-api-access-zkfzh\") pod \"multus-additional-cni-plugins-5r9pt\" (UID: \"e0c9d05a-e1ac-4222-ad57-ff1f57efec57\") " pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.381679 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.381628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kwl\" (UniqueName: \"kubernetes.io/projected/d201ed1a-b122-45bd-96bd-c42ce7cd66da-kube-api-access-p2kwl\") pod \"iptables-alerter-nr8dh\" (UID: \"d201ed1a-b122-45bd-96bd-c42ce7cd66da\") " pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.392238 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.392178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"a4f18a4042ac0c4f669794ed57bc7586","Type":"ContainerStarted","Data":"9c7691df30d23f95da5a63a82c0ff1c6241eec657f73decd98025df0a47a18a7"}
Jul 23 15:50:21.393330 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.393299    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerStarted","Data":"99082a9ec448f58de469fc53ce5b52db3fbcdb8ddd4b33bd67d61db1cef24bb3"}
Jul 23 15:50:21.472696 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8d355f-b264-4118-8a8d-f6000315b61f-tmp-dir\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.472696 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472661    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcppk\" (UniqueName: \"kubernetes.io/projected/81b71535-fc29-44c1-a128-1b781e38b209-kube-api-access-gcppk\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df8d355f-b264-4118-8a8d-f6000315b61f-hosts-file\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-host\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-device-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.472907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472887    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-host\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472927    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-etc-selinux\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-serviceca\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-device-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df8d355f-b264-4118-8a8d-f6000315b61f-hosts-file\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.472974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7v9\" (UniqueName: \"kubernetes.io/projected/df8d355f-b264-4118-8a8d-f6000315b61f-kube-api-access-zh7v9\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83410180-155f-4b82-ae5c-3d26d679a145-konnectivity-ca\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df8d355f-b264-4118-8a8d-f6000315b61f-tmp-dir\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-sys-fs\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgp8\" (UniqueName: \"kubernetes.io/projected/5daf9190-4726-4582-96a6-97c593d0aa80-kube-api-access-zrgp8\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-socket-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473182    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473276 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473268    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83410180-155f-4b82-ae5c-3d26d679a145-agent-certs\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.473924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t4hj\" (UniqueName: \"kubernetes.io/projected/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-kube-api-access-9t4hj\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.473924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-serviceca\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.473924 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.473442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5daf9190-4726-4582-96a6-97c593d0aa80-registration-dir\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.473924 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.473546    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:21.473924 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.473609    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:21.973592956 +0000 UTC m=+3.097018726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:21.474226 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.474197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83410180-155f-4b82-ae5c-3d26d679a145-konnectivity-ca\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.476036 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.476016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83410180-155f-4b82-ae5c-3d26d679a145-agent-certs\") pod \"konnectivity-agent-qlbc8\" (UID: \"83410180-155f-4b82-ae5c-3d26d679a145\") " pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.485418 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.485388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcppk\" (UniqueName: \"kubernetes.io/projected/81b71535-fc29-44c1-a128-1b781e38b209-kube-api-access-gcppk\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.486288 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.486250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgp8\" (UniqueName: \"kubernetes.io/projected/5daf9190-4726-4582-96a6-97c593d0aa80-kube-api-access-zrgp8\") pod \"aws-ebs-csi-driver-node-vz9z4\" (UID: \"5daf9190-4726-4582-96a6-97c593d0aa80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.487090 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.487072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t4hj\" (UniqueName: \"kubernetes.io/projected/e5fc243a-468d-4c61-bf9a-2d0656f4e83a-kube-api-access-9t4hj\") pod \"node-ca-sdcvj\" (UID: \"e5fc243a-468d-4c61-bf9a-2d0656f4e83a\") " pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.491048 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.491028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7v9\" (UniqueName: \"kubernetes.io/projected/df8d355f-b264-4118-8a8d-f6000315b61f-kube-api-access-zh7v9\") pod \"node-resolver-8vhn5\" (UID: \"df8d355f-b264-4118-8a8d-f6000315b61f\") " pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.556674 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.556638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9jwr"
Jul 23 15:50:21.573749 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.573713    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5r9pt"
Jul 23 15:50:21.581938 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.581912    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nr8dh"
Jul 23 15:50:21.588868 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.588842    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:21.595728 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.595706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zw975"
Jul 23 15:50:21.603578 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.603552    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:21.612393 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.612364    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8vhn5"
Jul 23 15:50:21.620375 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.620346    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sdcvj"
Jul 23 15:50:21.628219 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.628196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4"
Jul 23 15:50:21.875796 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.875698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:21.875969 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.875866    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:21.875969 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.875950    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:22.875927253 +0000 UTC m=+3.999353020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:21.976007 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.975976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:21.976166 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:21.976021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:21.976166 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976140    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:21.976254 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976170    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:21.976254 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976183    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:21.976254 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976192    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:21.976254 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976217    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:22.976196375 +0000 UTC m=+4.099622134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:21.976254 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:21.976234    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:22.976226294 +0000 UTC m=+4.099652050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:22.299069 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.299037    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:45:21 +0000 UTC" deadline="2028-02-08 11:52:43.444680843 +0000 UTC"
Jul 23 15:50:22.299069 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.299067    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13556h2m21.145616513s"
Jul 23 15:50:22.315030 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.314997    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a26b29a_0e7f_4c06_b381_db0f6eb8a7be.slice/crio-6644230fa6c57e1d9436827a47e4e07c3078bced6aa546bb3633c2b5ac593fb0 WatchSource:0}: Error finding container 6644230fa6c57e1d9436827a47e4e07c3078bced6aa546bb3633c2b5ac593fb0: Status 404 returned error can't find the container with id 6644230fa6c57e1d9436827a47e4e07c3078bced6aa546bb3633c2b5ac593fb0
Jul 23 15:50:22.315322 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.315294    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fc243a_468d_4c61_bf9a_2d0656f4e83a.slice/crio-167a776a621f20b9a054be5204a309379d1350188237af148f8fea2151a15a99 WatchSource:0}: Error finding container 167a776a621f20b9a054be5204a309379d1350188237af148f8fea2151a15a99: Status 404 returned error can't find the container with id 167a776a621f20b9a054be5204a309379d1350188237af148f8fea2151a15a99
Jul 23 15:50:22.317694 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.317671    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9105896e_c049_41a2_86fd_26c2d48cf42e.slice/crio-9b10478f66a81117c322cb10c376be213a97dc63000576511ea192936a4ae7ab WatchSource:0}: Error finding container 9b10478f66a81117c322cb10c376be213a97dc63000576511ea192936a4ae7ab: Status 404 returned error can't find the container with id 9b10478f66a81117c322cb10c376be213a97dc63000576511ea192936a4ae7ab
Jul 23 15:50:22.318511 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.318485    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83410180_155f_4b82_ae5c_3d26d679a145.slice/crio-ebd16bec267682c48b67b6e00f6dea0557c174402da78b82cc2c07832e3e9aae WatchSource:0}: Error finding container ebd16bec267682c48b67b6e00f6dea0557c174402da78b82cc2c07832e3e9aae: Status 404 returned error can't find the container with id ebd16bec267682c48b67b6e00f6dea0557c174402da78b82cc2c07832e3e9aae
Jul 23 15:50:22.322693 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.322666    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80322fc_74e7_4ffb_8e51_3333c3bd9d9f.slice/crio-a276ad41d54b1f7b8793d5c290fd0babb468559aa1bc162295529b9c74fe7122 WatchSource:0}: Error finding container a276ad41d54b1f7b8793d5c290fd0babb468559aa1bc162295529b9c74fe7122: Status 404 returned error can't find the container with id a276ad41d54b1f7b8793d5c290fd0babb468559aa1bc162295529b9c74fe7122
Jul 23 15:50:22.323461 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.323436    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c9d05a_e1ac_4222_ad57_ff1f57efec57.slice/crio-7f86019ce7917a8161bcb7ddfaf77282f1f2817f3d69f3743249406686fbc111 WatchSource:0}: Error finding container 7f86019ce7917a8161bcb7ddfaf77282f1f2817f3d69f3743249406686fbc111: Status 404 returned error can't find the container with id 7f86019ce7917a8161bcb7ddfaf77282f1f2817f3d69f3743249406686fbc111
Jul 23 15:50:22.325112 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.325089    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd201ed1a_b122_45bd_96bd_c42ce7cd66da.slice/crio-bdf0bba81a20c78066bd1a36829f2a68b3123f51f270ef07747652ba2c0783f0 WatchSource:0}: Error finding container bdf0bba81a20c78066bd1a36829f2a68b3123f51f270ef07747652ba2c0783f0: Status 404 returned error can't find the container with id bdf0bba81a20c78066bd1a36829f2a68b3123f51f270ef07747652ba2c0783f0
Jul 23 15:50:22.327057 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.327028    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf9190_4726_4582_96a6_97c593d0aa80.slice/crio-0149d4041a1a40d5f2955a2ec22ae133cc2fdc00bdedd82e08331110a9d00ce7 WatchSource:0}: Error finding container 0149d4041a1a40d5f2955a2ec22ae133cc2fdc00bdedd82e08331110a9d00ce7: Status 404 returned error can't find the container with id 0149d4041a1a40d5f2955a2ec22ae133cc2fdc00bdedd82e08331110a9d00ce7
Jul 23 15:50:22.328390 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:22.328245    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8d355f_b264_4118_8a8d_f6000315b61f.slice/crio-84d7a0602c6703420ed84c2ac15877905c7b08038a8abd2546afd2d7f74b6041 WatchSource:0}: Error finding container 84d7a0602c6703420ed84c2ac15877905c7b08038a8abd2546afd2d7f74b6041: Status 404 returned error can't find the container with id 84d7a0602c6703420ed84c2ac15877905c7b08038a8abd2546afd2d7f74b6041
Jul 23 15:50:22.387879 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.387847    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:22.388035 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.387862    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:22.388035 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.387975    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:22.388141 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.388038    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:22.396949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.396766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nr8dh" event={"ID":"d201ed1a-b122-45bd-96bd-c42ce7cd66da","Type":"ContainerStarted","Data":"bdf0bba81a20c78066bd1a36829f2a68b3123f51f270ef07747652ba2c0783f0"}
Jul 23 15:50:22.398057 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.397995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerStarted","Data":"7f86019ce7917a8161bcb7ddfaf77282f1f2817f3d69f3743249406686fbc111"}
Jul 23 15:50:22.399155 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.399137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9jwr" event={"ID":"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f","Type":"ContainerStarted","Data":"a276ad41d54b1f7b8793d5c290fd0babb468559aa1bc162295529b9c74fe7122"}
Jul 23 15:50:22.400362 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.400336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sdcvj" event={"ID":"e5fc243a-468d-4c61-bf9a-2d0656f4e83a","Type":"ContainerStarted","Data":"167a776a621f20b9a054be5204a309379d1350188237af148f8fea2151a15a99"}
Jul 23 15:50:22.401462 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.401443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"6644230fa6c57e1d9436827a47e4e07c3078bced6aa546bb3633c2b5ac593fb0"}
Jul 23 15:50:22.402535 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.402494    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8vhn5" event={"ID":"df8d355f-b264-4118-8a8d-f6000315b61f","Type":"ContainerStarted","Data":"84d7a0602c6703420ed84c2ac15877905c7b08038a8abd2546afd2d7f74b6041"}
Jul 23 15:50:22.404178 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.404155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4" event={"ID":"5daf9190-4726-4582-96a6-97c593d0aa80","Type":"ContainerStarted","Data":"0149d4041a1a40d5f2955a2ec22ae133cc2fdc00bdedd82e08331110a9d00ce7"}
Jul 23 15:50:22.405172 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.405150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlbc8" event={"ID":"83410180-155f-4b82-ae5c-3d26d679a145","Type":"ContainerStarted","Data":"ebd16bec267682c48b67b6e00f6dea0557c174402da78b82cc2c07832e3e9aae"}
Jul 23 15:50:22.406077 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.406055    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zw975" event={"ID":"9105896e-c049-41a2-86fd-26c2d48cf42e","Type":"ContainerStarted","Data":"9b10478f66a81117c322cb10c376be213a97dc63000576511ea192936a4ae7ab"}
Jul 23 15:50:22.883231 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.882384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:22.883231 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.882679    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:22.883231 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.882750    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.882730391 +0000 UTC m=+6.006156150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:22.983619 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.983577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:22.983793 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:22.983692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:22.983868 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.983819    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:22.983923 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.983885    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.983865755 +0000 UTC m=+6.107291514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:22.984322 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.984303    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:22.984390 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.984332    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:22.984390 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.984346    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:22.984488 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:22.984394    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.984378263 +0000 UTC m=+6.107804029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:23.300199 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.300088    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:45:21 +0000 UTC" deadline="2028-03-27 12:13:21.443473503 +0000 UTC"
Jul 23 15:50:23.300199 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.300152    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14708h22m58.143325214s"
Jul 23 15:50:23.303953 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.303926    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:23.388887 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.388356    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:23.388887 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:23.388506    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:23.423666 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.423033    2574 generic.go:356] "Generic (PLEG): container finished" podID="fa81fefd8cb9506ed41c32bd7a3ab6b4" containerID="ddbc174f4abd037602cc65c15dcfdbfe5935421d5f23df1ebbc5db85161c07a9" exitCode=0
Jul 23 15:50:23.423666 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.423128    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerDied","Data":"ddbc174f4abd037602cc65c15dcfdbfe5935421d5f23df1ebbc5db85161c07a9"}
Jul 23 15:50:23.432381 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.431889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" event={"ID":"a4f18a4042ac0c4f669794ed57bc7586","Type":"ContainerStarted","Data":"28f09fca736041544c931c16549dc3a347f9b4d98cb90ca6a6035cb856a4fe93"}
Jul 23 15:50:23.458072 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:23.457393    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-166.ec2.internal" podStartSLOduration=3.457371017 podStartE2EDuration="3.457371017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:23.457128171 +0000 UTC m=+4.580553947" watchObservedRunningTime="2026-07-23 15:50:23.457371017 +0000 UTC m=+4.580796795"
Jul 23 15:50:24.387962 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:24.387928    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:24.388410 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:24.388054    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:24.388602 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:24.388582    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:24.388731 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:24.388710    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:24.451895 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:24.451803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" event={"ID":"fa81fefd8cb9506ed41c32bd7a3ab6b4","Type":"ContainerStarted","Data":"96a2a42606652920d6be4017baa1af60b62219736c6e3514a57e114a30a5b249"}
Jul 23 15:50:24.901564 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:24.900935    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:24.901564 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:24.901132    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:24.901564 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:24.901191    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:28.901173508 +0000 UTC m=+10.024599268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:25.002290 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:25.002222    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:25.002290 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:25.002283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:25.002506 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.002448    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:25.002506 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.002471    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:25.002506 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.002482    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:25.002691 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.002551    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:29.002533817 +0000 UTC m=+10.125959588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:25.002971 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.002952    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:25.003072 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.003009    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:29.00299337 +0000 UTC m=+10.126419127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:25.389850 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:25.389773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:25.390317 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:25.389933    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:26.388293 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:26.388259    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:26.388486 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:26.388263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:26.388486 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:26.388381    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:26.388643 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:26.388501    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:27.389915 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:27.389881    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:27.390410 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:27.390047    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:28.388857 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:28.388801    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:28.388857 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:28.388852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:28.389106 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:28.388950    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:28.389191 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:28.389101    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:28.935699 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:28.935655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:28.936188 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:28.935831    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:28.936188 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:28.935907    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:36.935887098 +0000 UTC m=+18.059312852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:29.036366 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:29.036327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:29.036557 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:29.036385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:29.036557 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036514    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:29.036557 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036552    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:29.036714 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036568    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:29.036714 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036514    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:29.036714 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036627    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:37.036608814 +0000 UTC m=+18.160034587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:29.036714 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.036680    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:37.036659561 +0000 UTC m=+18.160085334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:29.389691 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:29.389574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:29.389877 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:29.389707    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:30.388775 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:30.388688    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:30.389210 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:30.388825    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:30.389210 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:30.388875    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:30.389210 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:30.388971    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:31.388807 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:31.388759    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:31.389260 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:31.388925    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:32.388207 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:32.388169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:32.388207 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:32.388195    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:32.388470 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:32.388294    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:32.388470 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:32.388380    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:33.388472 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:33.388431    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:33.389015 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:33.388605    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:34.388569 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:34.388535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:34.388972 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:34.388535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:34.388972 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:34.388655    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:34.388972 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:34.388752    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:35.387945 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:35.387916    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:35.388132 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:35.388055    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:36.388086 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:36.388046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:36.388086 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:36.388078    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:36.388616 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:36.388194    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:36.388616 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:36.388310    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:36.999289 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:36.999252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:36.999449 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:36.999414    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:36.999507 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:36.999495    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:50:52.999471373 +0000 UTC m=+34.122897138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:37.100462 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:37.100370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:37.100462 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:37.100425    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100553    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100591    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100610    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100623    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100637    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:53.100616086 +0000 UTC m=+34.224041843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:37.100818 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.100664    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:53.100650821 +0000 UTC m=+34.224076573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:37.388016 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:37.387933    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:37.388162 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:37.388110    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:38.387877 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:38.387840    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:38.387877 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:38.387876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:38.388135 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:38.387973    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:38.388135 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:38.388089    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:39.388978 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:39.388922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:39.389431 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:39.389053    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:40.388658 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:40.388625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:40.388855 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:40.388625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:40.388855 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:40.388731    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:40.388855 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:40.388841    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:41.389177 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.388879    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:41.389888 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:41.389258    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:41.488486 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.488453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4" event={"ID":"5daf9190-4726-4582-96a6-97c593d0aa80","Type":"ContainerStarted","Data":"6b1daac4526ea92dd3b43a76deb4c6da9cf70aeca424385b1ccaa3a824b5c8d4"}
Jul 23 15:50:41.491389 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.491345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qlbc8" event={"ID":"83410180-155f-4b82-ae5c-3d26d679a145","Type":"ContainerStarted","Data":"ee0ce4563ec85d39665b1faecf2e6d88161da17916025a91670cfcdc6d29360a"}
Jul 23 15:50:41.493515 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.493488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zw975" event={"ID":"9105896e-c049-41a2-86fd-26c2d48cf42e","Type":"ContainerStarted","Data":"b098ddd9632ecb7d643df29b868a31a69b93db01e6df9f88ae7570fcea687687"}
Jul 23 15:50:41.495108 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.495081    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="0d4ad737e4052aab5ec29c206f5e9bdc18fa1b66741599c1607b62f6b8f61cb5" exitCode=0
Jul 23 15:50:41.495216 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.495150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"0d4ad737e4052aab5ec29c206f5e9bdc18fa1b66741599c1607b62f6b8f61cb5"}
Jul 23 15:50:41.496938 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.496888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9jwr" event={"ID":"a80322fc-74e7-4ffb-8e51-3333c3bd9d9f","Type":"ContainerStarted","Data":"bd65085980c23f09218800f49801e178f05ec09ec8b3ad161d194af006b0490b"}
Jul 23 15:50:41.498314 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.498290    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sdcvj" event={"ID":"e5fc243a-468d-4c61-bf9a-2d0656f4e83a","Type":"ContainerStarted","Data":"f1c8ea32c4a121cd94d5d775343af3cafd29f529bdb62e27eeeb62ea8d268bc6"}
Jul 23 15:50:41.500446 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.500423    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"2733f5a56b93a836980d9a54fdfc151a177181b5316642de7dab736873064e2f"}
Jul 23 15:50:41.500551 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.500497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"70f7a4cbcf2288d2cf9f412e26f56e6c79f2a53d6eb7abf888547e2cfc80be25"}
Jul 23 15:50:41.501852 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.501833    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8vhn5" event={"ID":"df8d355f-b264-4118-8a8d-f6000315b61f","Type":"ContainerStarted","Data":"64777dc19c0628999353be8fc4ea75bd79de5c9d2b99526a71993a093d00a74d"}
Jul 23 15:50:41.505827 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.505788    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-166.ec2.internal" podStartSLOduration=21.505774962 podStartE2EDuration="21.505774962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:24.469363967 +0000 UTC m=+5.592789743" watchObservedRunningTime="2026-07-23 15:50:41.505774962 +0000 UTC m=+22.629200737"
Jul 23 15:50:41.505976 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.505958    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qlbc8" podStartSLOduration=8.002328061 podStartE2EDuration="22.505950981s" totalImagesPullingTime="14.50362292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:41.505408583 +0000 UTC m=+22.628834357" watchObservedRunningTime="2026-07-23 15:50:41.505950981 +0000 UTC m=+22.629376757"
Jul 23 15:50:41.527751 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.527698    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t9jwr" podStartSLOduration=3.828215477 podStartE2EDuration="22.527676881s" totalImagesPullingTime="18.699461404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:41.527665951 +0000 UTC m=+22.651091727" watchObservedRunningTime="2026-07-23 15:50:41.527676881 +0000 UTC m=+22.651102659"
Jul 23 15:50:41.564795 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.564743    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zw975" podStartSLOduration=3.903517628 podStartE2EDuration="22.56472574s" totalImagesPullingTime="18.661208112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:41.564599771 +0000 UTC m=+22.688025546" watchObservedRunningTime="2026-07-23 15:50:41.56472574 +0000 UTC m=+22.688151515"
Jul 23 15:50:41.580748 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.580698    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8vhn5" podStartSLOduration=3.939189007 podStartE2EDuration="22.580683545s" totalImagesPullingTime="18.641494538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:41.580512476 +0000 UTC m=+22.703938251" watchObservedRunningTime="2026-07-23 15:50:41.580683545 +0000 UTC m=+22.704109319"
Jul 23 15:50:41.596709 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:41.596634    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sdcvj" podStartSLOduration=3.946917596 podStartE2EDuration="22.596615129s" totalImagesPullingTime="18.649697533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:41.596098686 +0000 UTC m=+22.719524460" watchObservedRunningTime="2026-07-23 15:50:41.596615129 +0000 UTC m=+22.720040903"
Jul 23 15:50:42.388220 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.388185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:42.388473 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.388187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:42.388473 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:42.388331    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:42.388473 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:42.388404    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:42.507991 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.507905    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"f177bef9d92140fa1af355eb05331df47ea195d5506ddef0ee4ccb5b021314de"}
Jul 23 15:50:42.508511 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.508030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"5abe045c8f6dd128690fc5a4050b58fea7268a8f3059d68e2b3d77fbf9f81cfe"}
Jul 23 15:50:42.508511 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.508084    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"8de681a21d4aef9dd8ff93baf645d81c4443bf85e37895e7193028c982512b76"}
Jul 23 15:50:42.508511 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.508133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"c02d6bb4d20db28dcdfe774c84db87a39fe6f73546cca1fe2928e502ee21d670"}
Jul 23 15:50:42.509834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.509803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nr8dh" event={"ID":"d201ed1a-b122-45bd-96bd-c42ce7cd66da","Type":"ContainerStarted","Data":"00cdd67faf2082b8f90ca1876da5bca416e8262f11bcf45defad4b48112fba8c"}
Jul 23 15:50:42.525496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:42.525443    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nr8dh" podStartSLOduration=4.8872620300000005 podStartE2EDuration="23.525424714s" totalImagesPullingTime="18.638162684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:42.525143322 +0000 UTC m=+23.648569099" watchObservedRunningTime="2026-07-23 15:50:42.525424714 +0000 UTC m=+23.648850490"
Jul 23 15:50:43.212358 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.212327    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 15:50:43.333927 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.333691    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:50:43.212350818Z","UUID":"f33ea9d5-c22e-4eae-b65f-40f1300a6f80","Handler":null,"Name":"","Endpoint":""}
Jul 23 15:50:43.335249 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.335223    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 15:50:43.335393 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.335269    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 15:50:43.391972 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.391939    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:43.392145 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:43.392080    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:43.514011 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:43.513969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4" event={"ID":"5daf9190-4726-4582-96a6-97c593d0aa80","Type":"ContainerStarted","Data":"ef8cc64fc7eacd0b77abb854fef21260966afcc02240b9e1eda5dbf76a2fa89f"}
Jul 23 15:50:44.254943 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.254865    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:44.255642 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.255609    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:44.388308 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.388276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:44.388472 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.388318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:44.388472 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:44.388381    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:44.388602 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:44.388509    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:44.523683 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.523584    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"9f9e1d69f2a64f5886c22bc9daea612d61c560ef0b242a1e7401d157887d31dc"}
Jul 23 15:50:44.524136 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.523737    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:44.524412 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:44.524389    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qlbc8"
Jul 23 15:50:45.388439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:45.388402    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:45.388643 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:45.388552    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:46.388920 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.388742    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:46.389495 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.388758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:46.389495 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:46.389003    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:46.389495 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:46.389086    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:46.529947 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.529862    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="02270d21a5af50a8040b0efdaf567bb51b0b523d894712f16e63799662f64f42" exitCode=0
Jul 23 15:50:46.529947 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.529906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"02270d21a5af50a8040b0efdaf567bb51b0b523d894712f16e63799662f64f42"}
Jul 23 15:50:46.533848 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.533825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" event={"ID":"4a26b29a-0e7f-4c06-b381-db0f6eb8a7be","Type":"ContainerStarted","Data":"3969104d66b486cf5071fa8ffdfde190d57fed0e7533948f6a0904a5ca245968"}
Jul 23 15:50:46.534206 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.534192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:46.534289 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.534259    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:46.536380 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.536348    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4" event={"ID":"5daf9190-4726-4582-96a6-97c593d0aa80","Type":"ContainerStarted","Data":"6deb91329e34331a46dc4ab2e3e23c229673ba821453d6e581d0b97d345c6671"}
Jul 23 15:50:46.549670 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.549647    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:46.549798 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.549747    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:46.581964 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.581915    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" podStartSLOduration=8.864411006 podStartE2EDuration="27.58189819s" totalImagesPullingTime="18.717487184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:46.581325152 +0000 UTC m=+27.704750937" watchObservedRunningTime="2026-07-23 15:50:46.58189819 +0000 UTC m=+27.705323965"
Jul 23 15:50:46.602788 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:46.602729    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vz9z4" podStartSLOduration=4.194204183 podStartE2EDuration="27.602714192s" totalImagesPullingTime="23.408510009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:46.602367923 +0000 UTC m=+27.725793698" watchObservedRunningTime="2026-07-23 15:50:46.602714192 +0000 UTC m=+27.726140076"
Jul 23 15:50:47.388081 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:47.387985    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:47.388581 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:47.388137    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:47.538559 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:47.538510    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:50:48.104731 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.104490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jw7tl"]
Jul 23 15:50:48.104933 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.104828    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:48.104989 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:48.104929    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:48.107408 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.107385    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjkjv"]
Jul 23 15:50:48.107581 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.107502    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:48.107649 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:48.107621    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:48.108074 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.108054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t5t4"]
Jul 23 15:50:48.108187 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.108146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:48.108271 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:48.108251    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:48.542805 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.542708    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="e2994e0939ae115b3d68963bd82004c8248f0325d7537d81f4010541ff89cb21" exitCode=0
Jul 23 15:50:48.543343 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.542809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"e2994e0939ae115b3d68963bd82004c8248f0325d7537d81f4010541ff89cb21"}
Jul 23 15:50:48.543343 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:48.542959    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:50:49.388677 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:49.388634    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:49.388850 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:49.388750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:49.388850 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:49.388759    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:49.388930 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:49.388845    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:49.388930 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:49.388896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:49.388994 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:49.388952    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:50.551554 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:50.551449    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="098882cd79dc830a2f42d0769526eddcb36c9ead5072d5d0924ffee5f7e38f92" exitCode=0
Jul 23 15:50:50.551554 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:50.551509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"098882cd79dc830a2f42d0769526eddcb36c9ead5072d5d0924ffee5f7e38f92"}
Jul 23 15:50:51.064325 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.064235    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:50:51.064491 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.064477    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:50:51.077787 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.077731    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" podUID="4a26b29a-0e7f-4c06-b381-db0f6eb8a7be" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 23 15:50:51.086618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.086582    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp" podUID="4a26b29a-0e7f-4c06-b381-db0f6eb8a7be" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 23 15:50:51.388814 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.388777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:51.389012 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.388832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:51.389012 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:51.388777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:51.389012 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:51.388922    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:51.389173 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:51.389007    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:51.389173 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:51.389093    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:53.013484 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.013240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:53.013484 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.013478    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:53.014001 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.013569    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret podName:6b279901-b871-4d03-bb9e-bc748a79447d nodeName:}" failed. No retries permitted until 2026-07-23 15:51:25.013548485 +0000 UTC m=+66.136974260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret") pod "global-pull-secret-syncer-jw7tl" (UID: "6b279901-b871-4d03-bb9e-bc748a79447d") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:53.114537 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.114490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:53.114537 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.114548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:53.114789 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114653    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:53.114789 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114735    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs podName:81b71535-fc29-44c1-a128-1b781e38b209 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:25.1147126 +0000 UTC m=+66.238138353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs") pod "network-metrics-daemon-2t5t4" (UID: "81b71535-fc29-44c1-a128-1b781e38b209") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:53.114789 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114663    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:53.114789 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114788    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:53.114995 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114804    2574 projected.go:196] Error preparing data for projected volume kube-api-access-gh9k2 for pod openshift-network-diagnostics/network-check-target-vjkjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:53.114995 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.114864    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2 podName:21b786ad-72b1-4c3e-84ef-260908dfc295 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:25.114847327 +0000 UTC m=+66.238273093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gh9k2" (UniqueName: "kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2") pod "network-check-target-vjkjv" (UID: "21b786ad-72b1-4c3e-84ef-260908dfc295") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:53.388816 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.388773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:53.389011 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.388773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:53.389011 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.388914    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jw7tl" podUID="6b279901-b871-4d03-bb9e-bc748a79447d"
Jul 23 15:50:53.389131 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.388773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:53.389131 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.389032    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vjkjv" podUID="21b786ad-72b1-4c3e-84ef-260908dfc295"
Jul 23 15:50:53.389229 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.389168    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t5t4" podUID="81b71535-fc29-44c1-a128-1b781e38b209"
Jul 23 15:50:53.682417 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.682341    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-166.ec2.internal" event="NodeReady"
Jul 23 15:50:53.682622 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.682484    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 15:50:53.727126 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.727089    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-56rlr"]
Jul 23 15:50:53.730324 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.730300    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fwsbr"]
Jul 23 15:50:53.730480 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.730432    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.732555 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.732509    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.733261 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.733233    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 15:50:53.733261 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.733254    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 15:50:53.733418 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.733268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4nf5\""
Jul 23 15:50:53.735506 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.735483    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 15:50:53.735624 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.735558    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8tlr\""
Jul 23 15:50:53.735681 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.735483    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 15:50:53.735961 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.735937    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 15:50:53.744323 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.744263    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56rlr"]
Jul 23 15:50:53.745047 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.745023    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwsbr"]
Jul 23 15:50:53.821378 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6525e36-7b23-4467-9914-f15b11c1e1af-config-volume\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.821378 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwzz\" (UniqueName: \"kubernetes.io/projected/d6525e36-7b23-4467-9914-f15b11c1e1af-kube-api-access-ckwzz\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.821657 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f62dd0-2dcc-4940-b697-c760e19e4c7b-cert\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.821657 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821481    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.821657 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qcl\" (UniqueName: \"kubernetes.io/projected/41f62dd0-2dcc-4940-b697-c760e19e4c7b-kube-api-access-v8qcl\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.821657 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.821617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6525e36-7b23-4467-9914-f15b11c1e1af-tmp-dir\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922062 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6525e36-7b23-4467-9914-f15b11c1e1af-config-volume\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922062 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwzz\" (UniqueName: \"kubernetes.io/projected/d6525e36-7b23-4467-9914-f15b11c1e1af-kube-api-access-ckwzz\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922339 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f62dd0-2dcc-4940-b697-c760e19e4c7b-cert\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.922339 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922440 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.922356    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:53.922440 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:53.922415    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:50:54.422394505 +0000 UTC m=+35.545820277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:53.922582 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qcl\" (UniqueName: \"kubernetes.io/projected/41f62dd0-2dcc-4940-b697-c760e19e4c7b-kube-api-access-v8qcl\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.922582 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6525e36-7b23-4467-9914-f15b11c1e1af-tmp-dir\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922802 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6525e36-7b23-4467-9914-f15b11c1e1af-config-volume\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.922802 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.922794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6525e36-7b23-4467-9914-f15b11c1e1af-tmp-dir\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.927239 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.927218    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41f62dd0-2dcc-4940-b697-c760e19e4c7b-cert\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:53.931643 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.931594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwzz\" (UniqueName: \"kubernetes.io/projected/d6525e36-7b23-4467-9914-f15b11c1e1af-kube-api-access-ckwzz\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:53.934175 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:53.934121    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qcl\" (UniqueName: \"kubernetes.io/projected/41f62dd0-2dcc-4940-b697-c760e19e4c7b-kube-api-access-v8qcl\") pod \"ingress-canary-fwsbr\" (UID: \"41f62dd0-2dcc-4940-b697-c760e19e4c7b\") " pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:54.051346 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:54.051303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwsbr"
Jul 23 15:50:54.426952 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:54.426908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:54.427152 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:54.427108    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:54.427218 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:54.427196    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:50:55.427171104 +0000 UTC m=+36.550596859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:54.869027 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:54.868872    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwsbr"]
Jul 23 15:50:54.871632 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:50:54.871605    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f62dd0_2dcc_4940_b697_c760e19e4c7b.slice/crio-cb50de5b42482958d6a15324679f9a8e6e26a46a205a24a39a7e134febed016e WatchSource:0}: Error finding container cb50de5b42482958d6a15324679f9a8e6e26a46a205a24a39a7e134febed016e: Status 404 returned error can't find the container with id cb50de5b42482958d6a15324679f9a8e6e26a46a205a24a39a7e134febed016e
Jul 23 15:50:55.391189 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.391162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:50:55.391859 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.391256    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:50:55.391859 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.391284    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:50:55.394257 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.394231    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:50:55.394358 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.394232    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:50:55.395460 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.395444    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9k2x\""
Jul 23 15:50:55.395574 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.395478    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:50:55.395734 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.395694    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:50:55.395734 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.395710    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xglcr\""
Jul 23 15:50:55.434348 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.434313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:55.434549 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:55.434489    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:55.434640 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:55.434589    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:50:57.43456492 +0000 UTC m=+38.557990693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:55.565601 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.565567    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="e5e2aab2c3768c1295ac027ca9b34fe4e14412a05dfef15e51860b5604773044" exitCode=0
Jul 23 15:50:55.565803 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.565639    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"e5e2aab2c3768c1295ac027ca9b34fe4e14412a05dfef15e51860b5604773044"}
Jul 23 15:50:55.566897 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:55.566876    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwsbr" event={"ID":"41f62dd0-2dcc-4940-b697-c760e19e4c7b","Type":"ContainerStarted","Data":"cb50de5b42482958d6a15324679f9a8e6e26a46a205a24a39a7e134febed016e"}
Jul 23 15:50:56.573404 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:56.573358    2574 generic.go:356] "Generic (PLEG): container finished" podID="e0c9d05a-e1ac-4222-ad57-ff1f57efec57" containerID="05f2091fe31bf9f322322147d20552a16518fa4aa595a8d69bcd8dd2563ed629" exitCode=0
Jul 23 15:50:56.573850 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:56.573435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerDied","Data":"05f2091fe31bf9f322322147d20552a16518fa4aa595a8d69bcd8dd2563ed629"}
Jul 23 15:50:57.450240 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:57.450204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:50:57.450413 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:57.450358    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:57.450450 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:50:57.450424    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:51:01.450407436 +0000 UTC m=+42.573833234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:57.581053 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:57.581015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" event={"ID":"e0c9d05a-e1ac-4222-ad57-ff1f57efec57","Type":"ContainerStarted","Data":"c3e75b46567f8ef84e8c6af88946ab65906c1af3c3b40c6d6925dd88d05a805b"}
Jul 23 15:50:57.608056 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:57.608007    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5r9pt" podStartSLOduration=8.718116704 podStartE2EDuration="38.607987979s" totalImagesPullingTime="29.889871275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:57.607506616 +0000 UTC m=+38.730932392" watchObservedRunningTime="2026-07-23 15:50:57.607987979 +0000 UTC m=+38.731413755"
Jul 23 15:50:58.585025 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:58.584988    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwsbr" event={"ID":"41f62dd0-2dcc-4940-b697-c760e19e4c7b","Type":"ContainerStarted","Data":"c8d24875e765259d49c5242c56cef96c5205612111db19899eb3d96d50f2516c"}
Jul 23 15:50:58.600343 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:58.600295    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fwsbr" podStartSLOduration=2.895465555 podStartE2EDuration="5.600279801s" totalImagesPullingTime="2.704814246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:58.600229795 +0000 UTC m=+39.723655573" watchObservedRunningTime="2026-07-23 15:50:58.600279801 +0000 UTC m=+39.723705575"
Jul 23 15:50:59.968828 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:50:59.968795    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dpf2t"]
Jul 23 15:51:00.001353 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.001316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpf2t"]
Jul 23 15:51:00.001514 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.001425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.005369 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.005333    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8xfp\""
Jul 23 15:51:00.006561 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.006534    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 15:51:00.006561 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.006546    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 15:51:00.006561 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.006556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 15:51:00.006784 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.006548    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 15:51:00.169000 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.168962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24b086ab-ccfa-44fe-9a54-18fdba44b37f-data-volume\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.169179 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.169016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.169179 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.169066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.169179 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.169140    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bfx\" (UniqueName: \"kubernetes.io/projected/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-api-access-47bfx\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.169179 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.169175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24b086ab-ccfa-44fe-9a54-18fdba44b37f-crio-socket\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270323 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24b086ab-ccfa-44fe-9a54-18fdba44b37f-crio-socket\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270323 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24b086ab-ccfa-44fe-9a54-18fdba44b37f-data-volume\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270448    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24b086ab-ccfa-44fe-9a54-18fdba44b37f-crio-socket\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270516 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.270555    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bfx\" (UniqueName: \"kubernetes.io/projected/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-api-access-47bfx\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.270574    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.270641    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:00.770617724 +0000 UTC m=+41.894043499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.270663    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:00.77065225 +0000 UTC m=+41.894078009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.270715 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.270638    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24b086ab-ccfa-44fe-9a54-18fdba44b37f-data-volume\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.283073 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.283038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bfx\" (UniqueName: \"kubernetes.io/projected/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-api-access-47bfx\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.775028 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.774987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.775028 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:00.775024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:00.775291 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.775117    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.775291 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.775162    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.775291 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.775198    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:01.775178845 +0000 UTC m=+42.898604616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.775291 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:00.775216    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:01.775207746 +0000 UTC m=+42.898633500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:01.008658 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.008623    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"]
Jul 23 15:51:01.027950 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.027882    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"]
Jul 23 15:51:01.028080 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.027986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"
Jul 23 15:51:01.030779 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.030751    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 15:51:01.030898 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.030834    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rgdhx\""
Jul 23 15:51:01.030898 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.030846    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 15:51:01.178772 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.178737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqv7x\" (UniqueName: \"kubernetes.io/projected/774d42e6-9662-4690-b50b-ca3b124a9647-kube-api-access-tqv7x\") pod \"migrator-7cc9c7ffd7-dr9lh\" (UID: \"774d42e6-9662-4690-b50b-ca3b124a9647\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"
Jul 23 15:51:01.279339 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.279250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqv7x\" (UniqueName: \"kubernetes.io/projected/774d42e6-9662-4690-b50b-ca3b124a9647-kube-api-access-tqv7x\") pod \"migrator-7cc9c7ffd7-dr9lh\" (UID: \"774d42e6-9662-4690-b50b-ca3b124a9647\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"
Jul 23 15:51:01.287992 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.287967    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqv7x\" (UniqueName: \"kubernetes.io/projected/774d42e6-9662-4690-b50b-ca3b124a9647-kube-api-access-tqv7x\") pod \"migrator-7cc9c7ffd7-dr9lh\" (UID: \"774d42e6-9662-4690-b50b-ca3b124a9647\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"
Jul 23 15:51:01.337192 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.337160    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"
Jul 23 15:51:01.480711 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.480675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:01.480888 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.480820    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:51:01.480932 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.480891    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:51:09.480872763 +0000 UTC m=+50.604298518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:51:01.493022 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.492991    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh"]
Jul 23 15:51:01.511377 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:01.511341    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774d42e6_9662_4690_b50b_ca3b124a9647.slice/crio-96a27a2a1c6f02c9c159899473facea7a637b61068d4a8379e0829a1e3caf310 WatchSource:0}: Error finding container 96a27a2a1c6f02c9c159899473facea7a637b61068d4a8379e0829a1e3caf310: Status 404 returned error can't find the container with id 96a27a2a1c6f02c9c159899473facea7a637b61068d4a8379e0829a1e3caf310
Jul 23 15:51:01.593199 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.593160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh" event={"ID":"774d42e6-9662-4690-b50b-ca3b124a9647","Type":"ContainerStarted","Data":"96a27a2a1c6f02c9c159899473facea7a637b61068d4a8379e0829a1e3caf310"}
Jul 23 15:51:01.754434 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.754408    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8vhn5_df8d355f-b264-4118-8a8d-f6000315b61f/dns-node-resolver/0.log"
Jul 23 15:51:01.783287 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.783247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:01.783287 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:01.783286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:01.783482 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.783375    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:01.783482 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.783446    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:03.783427141 +0000 UTC m=+44.906852914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:01.783482 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.783452    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:01.783620 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:01.783497    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:03.783487043 +0000 UTC m=+44.906912796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:02.566972 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.566936    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvxr9"]
Jul 23 15:51:02.584064 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.584035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvxr9"]
Jul 23 15:51:02.584283 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.584151    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.587133 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.587108    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 15:51:02.588267 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.588233    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 15:51:02.588267 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.588232    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 15:51:02.588445 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.588293    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fh9rc\""
Jul 23 15:51:02.588445 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.588266    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 15:51:02.690427 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.690383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7f5\" (UniqueName: \"kubernetes.io/projected/6c136741-0a6f-46ed-9e7f-7df93f3148f8-kube-api-access-zb7f5\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.690427 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.690420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-key\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.690672 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.690447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-cabundle\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.791893 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.791852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7f5\" (UniqueName: \"kubernetes.io/projected/6c136741-0a6f-46ed-9e7f-7df93f3148f8-kube-api-access-zb7f5\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.791893 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.791893    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-key\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.792132 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.791914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-cabundle\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.792713 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.792690    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-cabundle\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.794653 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.794631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6c136741-0a6f-46ed-9e7f-7df93f3148f8-signing-key\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.800880 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.800858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7f5\" (UniqueName: \"kubernetes.io/projected/6c136741-0a6f-46ed-9e7f-7df93f3148f8-kube-api-access-zb7f5\") pod \"service-ca-58598695f7-mvxr9\" (UID: \"6c136741-0a6f-46ed-9e7f-7df93f3148f8\") " pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.896187 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.896150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mvxr9"
Jul 23 15:51:02.956635 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:02.956605    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sdcvj_e5fc243a-468d-4c61-bf9a-2d0656f4e83a/node-ca/0.log"
Jul 23 15:51:03.098569 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.098538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mvxr9"]
Jul 23 15:51:03.100635 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:03.100605    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c136741_0a6f_46ed_9e7f_7df93f3148f8.slice/crio-97c55ae3f819db5a443f474dd71749d0a8cbedd3476305c4e5e741f8152cbf77 WatchSource:0}: Error finding container 97c55ae3f819db5a443f474dd71749d0a8cbedd3476305c4e5e741f8152cbf77: Status 404 returned error can't find the container with id 97c55ae3f819db5a443f474dd71749d0a8cbedd3476305c4e5e741f8152cbf77
Jul 23 15:51:03.555763 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.555674    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwsbr_41f62dd0-2dcc-4940-b697-c760e19e4c7b/serve-healthcheck-canary/0.log"
Jul 23 15:51:03.599576 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.599531    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh" event={"ID":"774d42e6-9662-4690-b50b-ca3b124a9647","Type":"ContainerStarted","Data":"7e09927406fa2c2a5f04ab11f5f5112f985b36b75579be5f3f00e0f25d2d3b38"}
Jul 23 15:51:03.600019 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.599588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh" event={"ID":"774d42e6-9662-4690-b50b-ca3b124a9647","Type":"ContainerStarted","Data":"36c812aa12f77f3386dbfda04a0334caa7f36974ae1975f588435e82ad0d4df6"}
Jul 23 15:51:03.600714 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.600687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mvxr9" event={"ID":"6c136741-0a6f-46ed-9e7f-7df93f3148f8","Type":"ContainerStarted","Data":"97c55ae3f819db5a443f474dd71749d0a8cbedd3476305c4e5e741f8152cbf77"}
Jul 23 15:51:03.619538 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.619471    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dr9lh" podStartSLOduration=1.8379013629999998 podStartE2EDuration="3.619452901s" totalImagesPullingTime="1.781551538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:03.618764734 +0000 UTC m=+44.742190510" watchObservedRunningTime="2026-07-23 15:51:03.619452901 +0000 UTC m=+44.742878683"
Jul 23 15:51:03.797922 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.797880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:03.798085 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:03.797931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:03.798085 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:03.798018    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:03.798211 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:03.798093    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:03.798211 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:03.798100    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:07.798079939 +0000 UTC m=+48.921505692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:03.798211 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:03.798158    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:07.798144622 +0000 UTC m=+48.921570379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:06.610392 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:06.610360    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mvxr9" event={"ID":"6c136741-0a6f-46ed-9e7f-7df93f3148f8","Type":"ContainerStarted","Data":"fc0dffd70f8aa46865c2c20fdf8cf5d7018ab316b55bcd6c4b314e505182d112"}
Jul 23 15:51:06.628734 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:06.628686    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-mvxr9" podStartSLOduration=1.605955517 podStartE2EDuration="4.628669168s" totalImagesPullingTime="3.022713651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:06.628181205 +0000 UTC m=+47.751606981" watchObservedRunningTime="2026-07-23 15:51:06.628669168 +0000 UTC m=+47.752094943"
Jul 23 15:51:07.829331 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:07.829295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:07.829331 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:07.829337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:07.829910 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:07.829477    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:07.829910 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:07.829562    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls podName:24b086ab-ccfa-44fe-9a54-18fdba44b37f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:15.829542 +0000 UTC m=+56.952967775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dpf2t" (UID: "24b086ab-ccfa-44fe-9a54-18fdba44b37f") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:07.830008 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:07.829947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24b086ab-ccfa-44fe-9a54-18fdba44b37f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:09.543886 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:09.543838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:09.544373 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:09.543988    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:51:09.544373 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:09.544075    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls podName:d6525e36-7b23-4467-9914-f15b11c1e1af nodeName:}" failed. No retries permitted until 2026-07-23 15:51:25.544054687 +0000 UTC m=+66.667480463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls") pod "dns-default-56rlr" (UID: "d6525e36-7b23-4467-9914-f15b11c1e1af") : secret "dns-default-metrics-tls" not found
Jul 23 15:51:15.889471 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:15.889430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:15.891778 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:15.891754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24b086ab-ccfa-44fe-9a54-18fdba44b37f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dpf2t\" (UID: \"24b086ab-ccfa-44fe-9a54-18fdba44b37f\") " pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:15.912696 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:15.912668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dpf2t"
Jul 23 15:51:16.042338 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:16.042302    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dpf2t"]
Jul 23 15:51:16.045408 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:16.045379    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b086ab_ccfa_44fe_9a54_18fdba44b37f.slice/crio-3498d02657390c0cf5cc9fb6738b426bd0cb1d7a69172d0b2ff1a0106c4578d8 WatchSource:0}: Error finding container 3498d02657390c0cf5cc9fb6738b426bd0cb1d7a69172d0b2ff1a0106c4578d8: Status 404 returned error can't find the container with id 3498d02657390c0cf5cc9fb6738b426bd0cb1d7a69172d0b2ff1a0106c4578d8
Jul 23 15:51:16.637929 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:16.637884    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpf2t" event={"ID":"24b086ab-ccfa-44fe-9a54-18fdba44b37f","Type":"ContainerStarted","Data":"3498d02657390c0cf5cc9fb6738b426bd0cb1d7a69172d0b2ff1a0106c4578d8"}
Jul 23 15:51:21.087812 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:21.087779    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nw9cp"
Jul 23 15:51:21.656023 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:21.655984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpf2t" event={"ID":"24b086ab-ccfa-44fe-9a54-18fdba44b37f","Type":"ContainerStarted","Data":"7264133b81a36bc1906a5813267e9e23081a563f0b4613fa61604db72a630b9e"}
Jul 23 15:51:23.935551 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.935503    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"]
Jul 23 15:51:23.947635 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.947544    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"]
Jul 23 15:51:23.947823 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.947659    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:23.951042 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.950900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:23.951042 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.950959    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 15:51:23.951244 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.950959    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 15:51:23.952309 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.952121    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 15:51:23.953096 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.952927    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 15:51:23.953210 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.953168    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"]
Jul 23 15:51:23.955170 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.954452    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 15:51:23.955170 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.955736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 15:51:23.955170 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.955953    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 15:51:23.955170 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.956204    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 15:51:23.955170 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:23.956363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"]
Jul 23 15:51:24.058922 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.058884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.058922 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.058924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.059203 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.058953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6sg\" (UniqueName: \"kubernetes.io/projected/c815b4e4-44ec-41e0-8974-04362f560705-kube-api-access-nm6sg\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.059203 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c815b4e4-44ec-41e0-8974-04362f560705-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.059203 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059046    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4479e3f8-8e6b-479a-b284-bfa494a4a1db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.059203 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059136    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.059203 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4479e3f8-8e6b-479a-b284-bfa494a4a1db-tmp\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.059392 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9stk\" (UniqueName: \"kubernetes.io/projected/4479e3f8-8e6b-479a-b284-bfa494a4a1db-kube-api-access-w9stk\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.059392 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.059289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160611 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9stk\" (UniqueName: \"kubernetes.io/projected/4479e3f8-8e6b-479a-b284-bfa494a4a1db-kube-api-access-w9stk\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.160781 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160781 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160890 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160890 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6sg\" (UniqueName: \"kubernetes.io/projected/c815b4e4-44ec-41e0-8974-04362f560705-kube-api-access-nm6sg\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160890 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c815b4e4-44ec-41e0-8974-04362f560705-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.160890 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4479e3f8-8e6b-479a-b284-bfa494a4a1db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.161081 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.161346 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.160955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4479e3f8-8e6b-479a-b284-bfa494a4a1db-tmp\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.161739 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.161710    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4479e3f8-8e6b-479a-b284-bfa494a4a1db-tmp\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.161969 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.161931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c815b4e4-44ec-41e0-8974-04362f560705-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.163873 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.163827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.163873 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.163858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.164031 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.163948    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.164093 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.164034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4479e3f8-8e6b-479a-b284-bfa494a4a1db-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.165171 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.165146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c815b4e4-44ec-41e0-8974-04362f560705-ca\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.169329 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.169283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9stk\" (UniqueName: \"kubernetes.io/projected/4479e3f8-8e6b-479a-b284-bfa494a4a1db-kube-api-access-w9stk\") pod \"klusterlet-addon-workmgr-7fd5b859c8-gs792\" (UID: \"4479e3f8-8e6b-479a-b284-bfa494a4a1db\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.170165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.170140    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6sg\" (UniqueName: \"kubernetes.io/projected/c815b4e4-44ec-41e0-8974-04362f560705-kube-api-access-nm6sg\") pod \"cluster-proxy-proxy-agent-84b7cdcc7-zhzhj\" (UID: \"c815b4e4-44ec-41e0-8974-04362f560705\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:24.261825 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.261743    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:24.274746 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:24.274719    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"
Jul 23 15:51:25.068794 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.068749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:51:25.071472 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.071422    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:51:25.082414 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.082372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b279901-b871-4d03-bb9e-bc748a79447d-original-pull-secret\") pod \"global-pull-secret-syncer-jw7tl\" (UID: \"6b279901-b871-4d03-bb9e-bc748a79447d\") " pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:51:25.100737 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.100702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jw7tl"
Jul 23 15:51:25.169287 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.169253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:51:25.169432 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.169325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:51:25.173496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.172684    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:51:25.174577 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.174371    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:51:25.184751 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.184153    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:51:25.184751 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.184693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b71535-fc29-44c1-a128-1b781e38b209-metrics-certs\") pod \"network-metrics-daemon-2t5t4\" (UID: \"81b71535-fc29-44c1-a128-1b781e38b209\") " pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:51:25.193380 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.193329    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9k2\" (UniqueName: \"kubernetes.io/projected/21b786ad-72b1-4c3e-84ef-260908dfc295-kube-api-access-gh9k2\") pod \"network-check-target-vjkjv\" (UID: \"21b786ad-72b1-4c3e-84ef-260908dfc295\") " pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:51:25.200985 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.200945    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj"]
Jul 23 15:51:25.204898 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:25.204873    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc815b4e4_44ec_41e0_8974_04362f560705.slice/crio-ad4a232ac12db3f611ef8978149b5d7d93f4545d9c4606d4503288c60b42114c WatchSource:0}: Error finding container ad4a232ac12db3f611ef8978149b5d7d93f4545d9c4606d4503288c60b42114c: Status 404 returned error can't find the container with id ad4a232ac12db3f611ef8978149b5d7d93f4545d9c4606d4503288c60b42114c
Jul 23 15:51:25.215240 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:25.214485    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4479e3f8_8e6b_479a_b284_bfa494a4a1db.slice/crio-5fb66155bbc8cc694e567c8b7a50df5c899940e972e54de8d3cfaf28e913d35f WatchSource:0}: Error finding container 5fb66155bbc8cc694e567c8b7a50df5c899940e972e54de8d3cfaf28e913d35f: Status 404 returned error can't find the container with id 5fb66155bbc8cc694e567c8b7a50df5c899940e972e54de8d3cfaf28e913d35f
Jul 23 15:51:25.215728 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.215702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"]
Jul 23 15:51:25.259753 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.256145    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jw7tl"]
Jul 23 15:51:25.260529 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:25.260498    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b279901_b871_4d03_bb9e_bc748a79447d.slice/crio-574711feb7119defe9ecc86254a6ae983e97c1de63fbc44a608fdd58cffe515c WatchSource:0}: Error finding container 574711feb7119defe9ecc86254a6ae983e97c1de63fbc44a608fdd58cffe515c: Status 404 returned error can't find the container with id 574711feb7119defe9ecc86254a6ae983e97c1de63fbc44a608fdd58cffe515c
Jul 23 15:51:25.409301 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.409268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xglcr\""
Jul 23 15:51:25.413955 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.413928    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9k2x\""
Jul 23 15:51:25.417215 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.417192    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:51:25.422019 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.421998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t5t4"
Jul 23 15:51:25.546618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.546490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vjkjv"]
Jul 23 15:51:25.549172 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:25.549136    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b786ad_72b1_4c3e_84ef_260908dfc295.slice/crio-7ce10e26c5654bd576169e037d9abc94170107699025ec9513153057a9b8ee50 WatchSource:0}: Error finding container 7ce10e26c5654bd576169e037d9abc94170107699025ec9513153057a9b8ee50: Status 404 returned error can't find the container with id 7ce10e26c5654bd576169e037d9abc94170107699025ec9513153057a9b8ee50
Jul 23 15:51:25.564798 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.564772    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t5t4"]
Jul 23 15:51:25.567813 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:25.567789    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b71535_fc29_44c1_a128_1b781e38b209.slice/crio-03abb9755f3220b61c57214f3158d87eba8e259beb8677cff9076362a89b54e2 WatchSource:0}: Error finding container 03abb9755f3220b61c57214f3158d87eba8e259beb8677cff9076362a89b54e2: Status 404 returned error can't find the container with id 03abb9755f3220b61c57214f3158d87eba8e259beb8677cff9076362a89b54e2
Jul 23 15:51:25.572352 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.572328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:25.574612 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.574588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6525e36-7b23-4467-9914-f15b11c1e1af-metrics-tls\") pod \"dns-default-56rlr\" (UID: \"d6525e36-7b23-4467-9914-f15b11c1e1af\") " pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:25.670941 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.670848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jw7tl" event={"ID":"6b279901-b871-4d03-bb9e-bc748a79447d","Type":"ContainerStarted","Data":"574711feb7119defe9ecc86254a6ae983e97c1de63fbc44a608fdd58cffe515c"}
Jul 23 15:51:25.672303 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.672273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792" event={"ID":"4479e3f8-8e6b-479a-b284-bfa494a4a1db","Type":"ContainerStarted","Data":"5fb66155bbc8cc694e567c8b7a50df5c899940e972e54de8d3cfaf28e913d35f"}
Jul 23 15:51:25.674407 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.674375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpf2t" event={"ID":"24b086ab-ccfa-44fe-9a54-18fdba44b37f","Type":"ContainerStarted","Data":"bf978f3ebb4d5b5dcb6011479317bc67f6310b96c2ac234d391e46856bb2c468"}
Jul 23 15:51:25.675782 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.675749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t5t4" event={"ID":"81b71535-fc29-44c1-a128-1b781e38b209","Type":"ContainerStarted","Data":"03abb9755f3220b61c57214f3158d87eba8e259beb8677cff9076362a89b54e2"}
Jul 23 15:51:25.677023 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.676997    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjkjv" event={"ID":"21b786ad-72b1-4c3e-84ef-260908dfc295","Type":"ContainerStarted","Data":"7ce10e26c5654bd576169e037d9abc94170107699025ec9513153057a9b8ee50"}
Jul 23 15:51:25.678144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.678117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj" event={"ID":"c815b4e4-44ec-41e0-8974-04362f560705","Type":"ContainerStarted","Data":"ad4a232ac12db3f611ef8978149b5d7d93f4545d9c4606d4503288c60b42114c"}
Jul 23 15:51:25.846680 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.846644    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4nf5\""
Jul 23 15:51:25.855032 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:25.855002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:26.030419 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:26.030383    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56rlr"]
Jul 23 15:51:26.692872 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:26.692835    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56rlr" event={"ID":"d6525e36-7b23-4467-9914-f15b11c1e1af","Type":"ContainerStarted","Data":"8ddaf27319f93de77e6cc68d24f1752a5d99c603709f98f75d04a631b7aca95f"}
Jul 23 15:51:36.740239 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:36.740148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj" event={"ID":"c815b4e4-44ec-41e0-8974-04362f560705","Type":"ContainerStarted","Data":"5b6b3165b457dd14788443ad53d3cbdc5b208ab5647381d88fe12188917be796"}
Jul 23 15:51:37.746109 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.746072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jw7tl" event={"ID":"6b279901-b871-4d03-bb9e-bc748a79447d","Type":"ContainerStarted","Data":"bd58d0fb6ae618f26e92a324dc38658f4cd8228ec01feb34557a35c55d16cc82"}
Jul 23 15:51:37.747656 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.747627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792" event={"ID":"4479e3f8-8e6b-479a-b284-bfa494a4a1db","Type":"ContainerStarted","Data":"8eaa69e1e2a6c03712946abc3f7df1e537417a9922ef1f47c8b1b8c56994ca82"}
Jul 23 15:51:37.747811 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.747793    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:37.749794 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.749770    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792"
Jul 23 15:51:37.749911 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.749892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dpf2t" event={"ID":"24b086ab-ccfa-44fe-9a54-18fdba44b37f","Type":"ContainerStarted","Data":"cb47900077f433b341961a55ebb256898ec7ddc9c8a9a1c575255c4f75845a06"}
Jul 23 15:51:37.751605 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.751579    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t5t4" event={"ID":"81b71535-fc29-44c1-a128-1b781e38b209","Type":"ContainerStarted","Data":"aa589e99c09542172c88de209fc336ccbccb85a779fe5c350787c13b2be4f83d"}
Jul 23 15:51:37.751714 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.751629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t5t4" event={"ID":"81b71535-fc29-44c1-a128-1b781e38b209","Type":"ContainerStarted","Data":"ae38ac8ee4dd7ae4b0e1ca379d61f94e01543170159536a6c68a02dd33faaf18"}
Jul 23 15:51:37.752962 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.752940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vjkjv" event={"ID":"21b786ad-72b1-4c3e-84ef-260908dfc295","Type":"ContainerStarted","Data":"eeaf85b41fe7259d68e800cec1175d8e4eea37a6f4c515d8a57f911b90307b9d"}
Jul 23 15:51:37.753055 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.753006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:51:37.754781 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.754761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj" event={"ID":"c815b4e4-44ec-41e0-8974-04362f560705","Type":"ContainerStarted","Data":"bc430e157b3020a87bb829ad7e93d383ecd481894c88563a3330f55877afcd0e"}
Jul 23 15:51:37.754858 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.754795    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj" event={"ID":"c815b4e4-44ec-41e0-8974-04362f560705","Type":"ContainerStarted","Data":"30b8e73dfa07967774e3aed0c906d090a58b06262940c981c54f2391b648662e"}
Jul 23 15:51:37.756274 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.756253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56rlr" event={"ID":"d6525e36-7b23-4467-9914-f15b11c1e1af","Type":"ContainerStarted","Data":"acb53809c41a2cc0ae0bb463978ec143b3f3c4c00d8f2f007171f0461836d792"}
Jul 23 15:51:37.756372 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.756288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56rlr" event={"ID":"d6525e36-7b23-4467-9914-f15b11c1e1af","Type":"ContainerStarted","Data":"2f82188775f8536667f545d84f700051b53e649443204177e8306f4c7f3dda1b"}
Jul 23 15:51:37.756436 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.756395    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:37.762010 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.761968    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jw7tl" podStartSLOduration=67.422158873 podStartE2EDuration="1m18.761957306s" totalImagesPullingTime="11.339798433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.761863391 +0000 UTC m=+78.885289167" watchObservedRunningTime="2026-07-23 15:51:37.761957306 +0000 UTC m=+78.885383080"
Jul 23 15:51:37.780513 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.780459    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dpf2t" podStartSLOduration=18.375105595 podStartE2EDuration="38.780443175s" totalImagesPullingTime="20.40533758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.779358581 +0000 UTC m=+78.902784386" watchObservedRunningTime="2026-07-23 15:51:37.780443175 +0000 UTC m=+78.903868949"
Jul 23 15:51:37.799668 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.799576    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84b7cdcc7-zhzhj" podStartSLOduration=3.425247587 podStartE2EDuration="14.799555328s" totalImagesPullingTime="11.374307741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.799401985 +0000 UTC m=+78.922827797" watchObservedRunningTime="2026-07-23 15:51:37.799555328 +0000 UTC m=+78.922981104"
Jul 23 15:51:37.821124 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.821065    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2t5t4" podStartSLOduration=67.875443273 podStartE2EDuration="1m18.821043403s" totalImagesPullingTime="10.94560013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.8200864 +0000 UTC m=+78.943512202" watchObservedRunningTime="2026-07-23 15:51:37.821043403 +0000 UTC m=+78.944469201"
Jul 23 15:51:37.839439 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.839374    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fd5b859c8-gs792" podStartSLOduration=3.453543392 podStartE2EDuration="14.839353071s" totalImagesPullingTime="11.385809679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.838806552 +0000 UTC m=+78.962232328" watchObservedRunningTime="2026-07-23 15:51:37.839353071 +0000 UTC m=+78.962778847"
Jul 23 15:51:37.857014 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.856962    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-56rlr" podStartSLOduration=34.318430566 podStartE2EDuration="44.856944907s" totalImagesPullingTime="10.538514341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.856619091 +0000 UTC m=+78.980044867" watchObservedRunningTime="2026-07-23 15:51:37.856944907 +0000 UTC m=+78.980370682"
Jul 23 15:51:37.873517 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:37.873463    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vjkjv" podStartSLOduration=67.830582118 podStartE2EDuration="1m18.873445967s" totalImagesPullingTime="11.042863849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:37.872611784 +0000 UTC m=+78.996037559" watchObservedRunningTime="2026-07-23 15:51:37.873445967 +0000 UTC m=+78.996871741"
Jul 23 15:51:41.539863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.539714    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9mrjg"]
Jul 23 15:51:41.544127 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.544099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.546877 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.546846    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 15:51:41.547035 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.546909    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 15:51:41.547135 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.547087    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dbzlp\""
Jul 23 15:51:41.547211 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.547189    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 15:51:41.548963 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.548820    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 15:51:41.548963 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.548836    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 15:51:41.549132 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.549057    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 15:51:41.589863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.589810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-metrics-client-ca\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.589863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.589854    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.589863 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.589872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-sys\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.589955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-textfile\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.589990    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.590025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.590103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-wtmp\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590165 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.590153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nds44\" (UniqueName: \"kubernetes.io/projected/3b9f3847-2efc-4676-adfa-5590a792a5e0-kube-api-access-nds44\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.590421 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.590189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-root\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.690833 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-wtmp\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nds44\" (UniqueName: \"kubernetes.io/projected/3b9f3847-2efc-4676-adfa-5590a792a5e0-kube-api-access-nds44\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-root\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690963    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-metrics-client-ca\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.690988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691029 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-sys\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-textfile\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-wtmp\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-root\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b9f3847-2efc-4676-adfa-5590a792a5e0-sys\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:41.691207    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 15:51:41.691363 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:51:41.691267    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls podName:3b9f3847-2efc-4676-adfa-5590a792a5e0 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:42.191248612 +0000 UTC m=+83.314674380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls") pod "node-exporter-9mrjg" (UID: "3b9f3847-2efc-4676-adfa-5590a792a5e0") : secret "node-exporter-tls" not found
Jul 23 15:51:41.691697 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691697 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-textfile\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.691823 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.691806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b9f3847-2efc-4676-adfa-5590a792a5e0-metrics-client-ca\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.693327 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.693305    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:41.700077 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:41.700044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nds44\" (UniqueName: \"kubernetes.io/projected/3b9f3847-2efc-4676-adfa-5590a792a5e0-kube-api-access-nds44\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:42.194832 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:42.194792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:42.197078 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:42.197054    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b9f3847-2efc-4676-adfa-5590a792a5e0-node-exporter-tls\") pod \"node-exporter-9mrjg\" (UID: \"3b9f3847-2efc-4676-adfa-5590a792a5e0\") " pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:42.461496 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:42.461404    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9mrjg"
Jul 23 15:51:42.600163 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:42.600122    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9f3847_2efc_4676_adfa_5590a792a5e0.slice/crio-ac3554195fe6a8ecdb4dfb9c6e3b0cbdc5a0aaa5630a4b90ae36c16f2a8578f9 WatchSource:0}: Error finding container ac3554195fe6a8ecdb4dfb9c6e3b0cbdc5a0aaa5630a4b90ae36c16f2a8578f9: Status 404 returned error can't find the container with id ac3554195fe6a8ecdb4dfb9c6e3b0cbdc5a0aaa5630a4b90ae36c16f2a8578f9
Jul 23 15:51:42.778789 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:42.778697    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mrjg" event={"ID":"3b9f3847-2efc-4676-adfa-5590a792a5e0","Type":"ContainerStarted","Data":"ac3554195fe6a8ecdb4dfb9c6e3b0cbdc5a0aaa5630a4b90ae36c16f2a8578f9"}
Jul 23 15:51:44.789257 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:44.789221    2574 generic.go:356] "Generic (PLEG): container finished" podID="3b9f3847-2efc-4676-adfa-5590a792a5e0" containerID="a1c28cf46a813dc9c09ae38dee67bd728a338128786f63e278353cde71d1c778" exitCode=0
Jul 23 15:51:44.789676 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:44.789301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mrjg" event={"ID":"3b9f3847-2efc-4676-adfa-5590a792a5e0","Type":"ContainerDied","Data":"a1c28cf46a813dc9c09ae38dee67bd728a338128786f63e278353cde71d1c778"}
Jul 23 15:51:45.795016 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:45.794987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mrjg" event={"ID":"3b9f3847-2efc-4676-adfa-5590a792a5e0","Type":"ContainerStarted","Data":"600399c865f91c394144ff42133f99d8bc3a5a9ac1826fa5d3cec762c155f675"}
Jul 23 15:51:45.795411 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:45.795037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9mrjg" event={"ID":"3b9f3847-2efc-4676-adfa-5590a792a5e0","Type":"ContainerStarted","Data":"76aac6cd8d1628ee60133189d4f90a9bfaa3ceebcccee4bbd78f055f3a3a53f3"}
Jul 23 15:51:45.820019 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:45.818017    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9mrjg" podStartSLOduration=3.167455366 podStartE2EDuration="4.817995839s" totalImagesPullingTime="1.571691275s" totalInitContainerRuntime="78.849198ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:45.817027098 +0000 UTC m=+86.940452877" watchObservedRunningTime="2026-07-23 15:51:45.817995839 +0000 UTC m=+86.941421615"
Jul 23 15:51:47.767157 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:47.767126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-56rlr"
Jul 23 15:51:48.102905 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.102870    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:51:48.141022 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.140992    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:51:48.141174 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.141093    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.143947 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.143906    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 15:51:48.144097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.143972    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 15:51:48.144097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.144006    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 15:51:48.144097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.144026    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 15:51:48.144097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.143972    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 15:51:48.144097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.144011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fg6wd\""
Jul 23 15:51:48.145077 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.145056    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 15:51:48.145199 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.145149    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 15:51:48.149661 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.149642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 15:51:48.236971 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.236939    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsr9\" (UniqueName: \"kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.236971 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.236979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.237197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.237006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.237197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.237030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.237197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.237058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.237197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.237075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.237197 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.237130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338296 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338296 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsr9\" (UniqueName: \"kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.338594 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.338438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.339236 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.339210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.339373 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.339210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.339373 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.339260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.339373 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.339273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.341078 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.341055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.341078 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.341073    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.347508 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.347483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsr9\" (UniqueName: \"kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9\") pod \"console-cbcc9fcdd-n5wfx\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") " pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.450834 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.450733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:48.616643 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.616609    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:51:48.620062 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:51:48.620030    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c7b1eb_bc84_42c2_9a70_972313dc4424.slice/crio-67d8045a5b87f9b4f2e450565a93d966484dfc6cb8f4fd0dd6a10378decf2147 WatchSource:0}: Error finding container 67d8045a5b87f9b4f2e450565a93d966484dfc6cb8f4fd0dd6a10378decf2147: Status 404 returned error can't find the container with id 67d8045a5b87f9b4f2e450565a93d966484dfc6cb8f4fd0dd6a10378decf2147
Jul 23 15:51:48.806851 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:48.806768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc9fcdd-n5wfx" event={"ID":"53c7b1eb-bc84-42c2-9a70-972313dc4424","Type":"ContainerStarted","Data":"67d8045a5b87f9b4f2e450565a93d966484dfc6cb8f4fd0dd6a10378decf2147"}
Jul 23 15:51:52.822741 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:52.822694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc9fcdd-n5wfx" event={"ID":"53c7b1eb-bc84-42c2-9a70-972313dc4424","Type":"ContainerStarted","Data":"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"}
Jul 23 15:51:52.841647 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:52.841583    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cbcc9fcdd-n5wfx" podStartSLOduration=1.296377706 podStartE2EDuration="4.841568337s" totalImagesPullingTime="3.545190631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:52.841361897 +0000 UTC m=+93.964787698" watchObservedRunningTime="2026-07-23 15:51:52.841568337 +0000 UTC m=+93.964994112"
Jul 23 15:51:58.451705 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:58.451662    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:58.452119 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:58.451727    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:58.456704 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:58.456679    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:51:58.845509 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:51:58.845483    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:52:08.767116 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:52:08.767086    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vjkjv"
Jul 23 15:52:10.814691 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:52:10.814656    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwsbr_41f62dd0-2dcc-4940-b697-c760e19e4c7b/serve-healthcheck-canary/0.log"
Jul 23 15:53:20.519459 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:20.519381    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:53:45.539949 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.539900    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cbcc9fcdd-n5wfx" podUID="53c7b1eb-bc84-42c2-9a70-972313dc4424" containerName="console" containerID="cri-o://c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc" gracePeriod=15
Jul 23 15:53:45.783774 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.783744    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:53:45.868986 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.868950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869011    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869036    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869053    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869072    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869144 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgsr9\" (UniqueName: \"kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869406 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869233    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca\") pod \"53c7b1eb-bc84-42c2-9a70-972313dc4424\" (UID: \"53c7b1eb-bc84-42c2-9a70-972313dc4424\") "
Jul 23 15:53:45.869595 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869557    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:45.869595 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869565    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config" (OuterVolumeSpecName: "console-config") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:45.869778 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:45.869778 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.869758    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca" (OuterVolumeSpecName: "service-ca") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:45.871347 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.871323    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:45.871347 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.871335    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9" (OuterVolumeSpecName: "kube-api-access-tgsr9") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "kube-api-access-tgsr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:53:45.871458 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.871374    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53c7b1eb-bc84-42c2-9a70-972313dc4424" (UID: "53c7b1eb-bc84-42c2-9a70-972313dc4424"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:45.970650 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970615    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-oauth-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970650 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970645    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-oauth-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970650 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970654    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-trusted-ca-bundle\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970650 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970662    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-config\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970671    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgsr9\" (UniqueName: \"kubernetes.io/projected/53c7b1eb-bc84-42c2-9a70-972313dc4424-kube-api-access-tgsr9\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970680    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c7b1eb-bc84-42c2-9a70-972313dc4424-service-ca\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:45.970907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:45.970688    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7b1eb-bc84-42c2-9a70-972313dc4424-console-serving-cert\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 15:53:46.203791 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.203700    2574 generic.go:356] "Generic (PLEG): container finished" podID="53c7b1eb-bc84-42c2-9a70-972313dc4424" containerID="c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc" exitCode=0
Jul 23 15:53:46.203791 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.203743    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc9fcdd-n5wfx"
Jul 23 15:53:46.203963 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.203794    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc9fcdd-n5wfx" event={"ID":"53c7b1eb-bc84-42c2-9a70-972313dc4424","Type":"ContainerDied","Data":"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"}
Jul 23 15:53:46.203963 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.203845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc9fcdd-n5wfx" event={"ID":"53c7b1eb-bc84-42c2-9a70-972313dc4424","Type":"ContainerDied","Data":"67d8045a5b87f9b4f2e450565a93d966484dfc6cb8f4fd0dd6a10378decf2147"}
Jul 23 15:53:46.203963 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.203871    2574 scope.go:117] "RemoveContainer" containerID="c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"
Jul 23 15:53:46.212716 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.212695    2574 scope.go:117] "RemoveContainer" containerID="c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"
Jul 23 15:53:46.212997 ip-10-0-130-166 kubenswrapper[2574]: E0723 15:53:46.212979    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc\": container with ID starting with c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc not found: ID does not exist" containerID="c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"
Jul 23 15:53:46.213046 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.213005    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc"} err="failed to get container status \"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc\": rpc error: code = NotFound desc = could not find container \"c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc\": container with ID starting with c8c507986cc2353fd693c8e1b84ac010ba8365e795476ade9ce1b9f5a81e7bcc not found: ID does not exist"
Jul 23 15:53:46.223776 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.223750    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:53:46.228993 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:46.228971    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cbcc9fcdd-n5wfx"]
Jul 23 15:53:47.392128 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:53:47.392085    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c7b1eb-bc84-42c2-9a70-972313dc4424" path="/var/lib/kubelet/pods/53c7b1eb-bc84-42c2-9a70-972313dc4424/volumes"
Jul 23 15:55:19.263766 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:55:19.263737    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 15:56:01.109575 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.109537    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"]
Jul 23 15:56:01.109994 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.109784    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c7b1eb-bc84-42c2-9a70-972313dc4424" containerName="console"
Jul 23 15:56:01.109994 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.109794    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c7b1eb-bc84-42c2-9a70-972313dc4424" containerName="console"
Jul 23 15:56:01.109994 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.109831    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="53c7b1eb-bc84-42c2-9a70-972313dc4424" containerName="console"
Jul 23 15:56:01.111409 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.111394    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.114020 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.114001    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 15:56:01.114020 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.114013    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 15:56:01.115159 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.115145    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wv6hz\""
Jul 23 15:56:01.120815 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.120790    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"]
Jul 23 15:56:01.176757 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.176715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fn2\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-kube-api-access-v9fn2\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.176757 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.176761    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.277384 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.277343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fn2\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-kube-api-access-v9fn2\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.277559 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.277392    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.285969 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.285939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.286102 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.286082    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fn2\" (UniqueName: \"kubernetes.io/projected/bd471ce9-3a85-4201-b5bb-69b27d16f72f-kube-api-access-v9fn2\") pod \"cert-manager-cainjector-559cdd8c87-svpp2\" (UID: \"bd471ce9-3a85-4201-b5bb-69b27d16f72f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.420716 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.420626    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"
Jul 23 15:56:01.552155 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.552110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-svpp2"]
Jul 23 15:56:01.554349 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:56:01.554309    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd471ce9_3a85_4201_b5bb_69b27d16f72f.slice/crio-ae96f27682d36ecc2c0eae79f8665246992619651f6cc30035c633dc573cea84 WatchSource:0}: Error finding container ae96f27682d36ecc2c0eae79f8665246992619651f6cc30035c633dc573cea84: Status 404 returned error can't find the container with id ae96f27682d36ecc2c0eae79f8665246992619651f6cc30035c633dc573cea84
Jul 23 15:56:01.556188 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.556173    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:56:01.634899 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:01.634866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2" event={"ID":"bd471ce9-3a85-4201-b5bb-69b27d16f72f","Type":"ContainerStarted","Data":"ae96f27682d36ecc2c0eae79f8665246992619651f6cc30035c633dc573cea84"}
Jul 23 15:56:04.647501 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:04.647469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2" event={"ID":"bd471ce9-3a85-4201-b5bb-69b27d16f72f","Type":"ContainerStarted","Data":"52beb102231e7b62aaa926d15e360e02280a4ef72acbd393c5b97077b399e66c"}
Jul 23 15:56:04.668937 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:04.668882    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-svpp2" podStartSLOduration=0.735560777 podStartE2EDuration="3.668862766s" totalImagesPullingTime="2.933301989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:04.666981813 +0000 UTC m=+345.790407589" watchObservedRunningTime="2026-07-23 15:56:04.668862766 +0000 UTC m=+345.792288541"
Jul 23 15:56:08.957891 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.957852    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"]
Jul 23 15:56:08.959901 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.959885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:08.963168 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.963148    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 15:56:08.964335 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.964317    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:56:08.964434 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.964318    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sqv96\""
Jul 23 15:56:08.979588 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:08.979553    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"]
Jul 23 15:56:09.030735 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.030691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh57p\" (UniqueName: \"kubernetes.io/projected/d98b9de9-5c85-405d-a344-622015e7bbe9-kube-api-access-fh57p\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.030929 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.030749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98b9de9-5c85-405d-a344-622015e7bbe9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.131339 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.131300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh57p\" (UniqueName: \"kubernetes.io/projected/d98b9de9-5c85-405d-a344-622015e7bbe9-kube-api-access-fh57p\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.131515 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.131352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98b9de9-5c85-405d-a344-622015e7bbe9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.131699 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.131684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98b9de9-5c85-405d-a344-622015e7bbe9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.142061 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.142028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh57p\" (UniqueName: \"kubernetes.io/projected/d98b9de9-5c85-405d-a344-622015e7bbe9-kube-api-access-fh57p\") pod \"openshift-lws-operator-fd8ccff4c-gsj9t\" (UID: \"d98b9de9-5c85-405d-a344-622015e7bbe9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.268638 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.268554    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"
Jul 23 15:56:09.399719 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.399653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t"]
Jul 23 15:56:09.402769 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:56:09.402737    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd98b9de9_5c85_405d_a344_622015e7bbe9.slice/crio-9efcd1129376ffe3f9aecda0f6907e54365be458d354f71bde491c736f97d345 WatchSource:0}: Error finding container 9efcd1129376ffe3f9aecda0f6907e54365be458d354f71bde491c736f97d345: Status 404 returned error can't find the container with id 9efcd1129376ffe3f9aecda0f6907e54365be458d354f71bde491c736f97d345
Jul 23 15:56:09.671733 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:09.671700    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t" event={"ID":"d98b9de9-5c85-405d-a344-622015e7bbe9","Type":"ContainerStarted","Data":"9efcd1129376ffe3f9aecda0f6907e54365be458d354f71bde491c736f97d345"}
Jul 23 15:56:12.684916 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:12.684880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t" event={"ID":"d98b9de9-5c85-405d-a344-622015e7bbe9","Type":"ContainerStarted","Data":"4c48dc34d2c507cedb66f6e4d53d78383f041a726ae05b062236d61093ccf99d"}
Jul 23 15:56:12.711019 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:12.710961    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gsj9t" podStartSLOduration=1.7985082129999999 podStartE2EDuration="4.71094301s" totalImagesPullingTime="2.912434797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:12.710214856 +0000 UTC m=+353.833640642" watchObservedRunningTime="2026-07-23 15:56:12.71094301 +0000 UTC m=+353.834368784"
Jul 23 15:56:32.644864 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.644828    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"]
Jul 23 15:56:32.694736 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.694697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.698399 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.698297    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vh7z7\""
Jul 23 15:56:32.698610 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.698429    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 15:56:32.698610 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.698434    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 15:56:32.698610 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.698469    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 15:56:32.698907 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.698888    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 15:56:32.701500 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.701471    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"]
Jul 23 15:56:32.799569 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.799511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49m2l\" (UniqueName: \"kubernetes.io/projected/e2ab2310-75da-4c11-90a9-a583c2d60b19-kube-api-access-49m2l\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.799741 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.799604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.799741 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.799627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.799741 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.799653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.799741 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.799670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.900920 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.900834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.900920 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.900872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.900920 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.900899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.900920 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.900917    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.901178 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.900951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49m2l\" (UniqueName: \"kubernetes.io/projected/e2ab2310-75da-4c11-90a9-a583c2d60b19-kube-api-access-49m2l\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.901307 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.901277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.903322 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.903290    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2ab2310-75da-4c11-90a9-a583c2d60b19-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.903498 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.903476    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.903562 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.903516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2ab2310-75da-4c11-90a9-a583c2d60b19-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:32.912193 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:32.912164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49m2l\" (UniqueName: \"kubernetes.io/projected/e2ab2310-75da-4c11-90a9-a583c2d60b19-kube-api-access-49m2l\") pod \"opendatahub-operator-controller-manager-575b84b7c9-qzk6f\" (UID: \"e2ab2310-75da-4c11-90a9-a583c2d60b19\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:33.007050 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:33.007000    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:33.189817 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:33.189744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"]
Jul 23 15:56:33.193436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:56:33.193408    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ab2310_75da_4c11_90a9_a583c2d60b19.slice/crio-ad007bc9114f4a2e90d54e2589fa2c64383dcc55bd262faacaea62d837eb8780 WatchSource:0}: Error finding container ad007bc9114f4a2e90d54e2589fa2c64383dcc55bd262faacaea62d837eb8780: Status 404 returned error can't find the container with id ad007bc9114f4a2e90d54e2589fa2c64383dcc55bd262faacaea62d837eb8780
Jul 23 15:56:33.765024 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:33.764993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f" event={"ID":"e2ab2310-75da-4c11-90a9-a583c2d60b19","Type":"ContainerStarted","Data":"ad007bc9114f4a2e90d54e2589fa2c64383dcc55bd262faacaea62d837eb8780"}
Jul 23 15:56:36.778044 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:36.778002    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f" event={"ID":"e2ab2310-75da-4c11-90a9-a583c2d60b19","Type":"ContainerStarted","Data":"9911b640be6718e35a6678e8e0ce0243d91763df197f0ae5c517d62c45e2166d"}
Jul 23 15:56:37.783086 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:37.783000    2574 generic.go:356] "Generic (PLEG): container finished" podID="e2ab2310-75da-4c11-90a9-a583c2d60b19" containerID="9911b640be6718e35a6678e8e0ce0243d91763df197f0ae5c517d62c45e2166d" exitCode=0
Jul 23 15:56:37.783434 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:37.783086    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f" event={"ID":"e2ab2310-75da-4c11-90a9-a583c2d60b19","Type":"ContainerDied","Data":"9911b640be6718e35a6678e8e0ce0243d91763df197f0ae5c517d62c45e2166d"}
Jul 23 15:56:38.788237 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:38.788203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f" event={"ID":"e2ab2310-75da-4c11-90a9-a583c2d60b19","Type":"ContainerStarted","Data":"2a0c37acf92150e1ac7195596b52f13ac444040a43299f24cc65df84202d0072"}
Jul 23 15:56:38.788735 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:38.788321    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:38.822230 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:38.822174    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f" podStartSLOduration=2.213029357 podStartE2EDuration="6.822156874s" totalImagesPullingTime="3.519588823s" totalInitContainerRuntime="1.089538694s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:38.821054926 +0000 UTC m=+379.944480732" watchObservedRunningTime="2026-07-23 15:56:38.822156874 +0000 UTC m=+379.945582648"
Jul 23 15:56:49.794577 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:49.794540    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-qzk6f"
Jul 23 15:56:56.083181 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.083150    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"]
Jul 23 15:56:56.088297 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.088269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.092923 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.092902    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 15:56:56.093065 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.092900    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 15:56:56.093111 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.093082    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 15:56:56.094292 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.094275    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kpkc2\""
Jul 23 15:56:56.107971 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.107935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"]
Jul 23 15:56:56.112352 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.112329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 15:56:56.183112 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.183076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r58l\" (UniqueName: \"kubernetes.io/projected/a258df90-2cd6-4429-a1fe-fe18ef293db8-kube-api-access-9r58l\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.183112 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.183118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a258df90-2cd6-4429-a1fe-fe18ef293db8-tmp\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.183345 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.183143    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a258df90-2cd6-4429-a1fe-fe18ef293db8-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.283485 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.283447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r58l\" (UniqueName: \"kubernetes.io/projected/a258df90-2cd6-4429-a1fe-fe18ef293db8-kube-api-access-9r58l\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.283485 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.283491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a258df90-2cd6-4429-a1fe-fe18ef293db8-tmp\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.283763 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.283517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a258df90-2cd6-4429-a1fe-fe18ef293db8-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.286021 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.285994    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a258df90-2cd6-4429-a1fe-fe18ef293db8-tmp\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.286253 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.286233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a258df90-2cd6-4429-a1fe-fe18ef293db8-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.300618 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.300591    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r58l\" (UniqueName: \"kubernetes.io/projected/a258df90-2cd6-4429-a1fe-fe18ef293db8-kube-api-access-9r58l\") pod \"kube-auth-proxy-7c56c994b9-p2gvf\" (UID: \"a258df90-2cd6-4429-a1fe-fe18ef293db8\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.398390 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.398291    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"
Jul 23 15:56:56.572985 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.571443    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf"]
Jul 23 15:56:56.575092 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:56:56.575059    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda258df90_2cd6_4429_a1fe_fe18ef293db8.slice/crio-e8ff4acb559cb8c6177f9f48cca1ba2acb4338214061512d6ec450cff8aa10b8 WatchSource:0}: Error finding container e8ff4acb559cb8c6177f9f48cca1ba2acb4338214061512d6ec450cff8aa10b8: Status 404 returned error can't find the container with id e8ff4acb559cb8c6177f9f48cca1ba2acb4338214061512d6ec450cff8aa10b8
Jul 23 15:56:56.852687 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:56.852652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf" event={"ID":"a258df90-2cd6-4429-a1fe-fe18ef293db8","Type":"ContainerStarted","Data":"e8ff4acb559cb8c6177f9f48cca1ba2acb4338214061512d6ec450cff8aa10b8"}
Jul 23 15:56:59.865823 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:59.865791    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf" event={"ID":"a258df90-2cd6-4429-a1fe-fe18ef293db8","Type":"ContainerStarted","Data":"32b43c81f46432e7629c87dfb4afe80ab0fe70ed50ce0cecebad2e8250143567"}
Jul 23 15:56:59.980987 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:56:59.980931    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-p2gvf" podStartSLOduration=2.457015347 podStartE2EDuration="4.980911596s" totalImagesPullingTime="2.523896249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:59.970738242 +0000 UTC m=+401.094164017" watchObservedRunningTime="2026-07-23 15:56:59.980911596 +0000 UTC m=+401.104337370"
Jul 23 15:57:02.844795 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.844756    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"]
Jul 23 15:57:02.847110 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.847085    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:02.852576 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.852552    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n5sjs\""
Jul 23 15:57:02.852727 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.852556    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 15:57:02.852727 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.852557    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 15:57:02.852727 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.852563    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 15:57:02.869854 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.869824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"]
Jul 23 15:57:02.936968 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.936930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-metrics-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:02.936968 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.936975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:02.937183 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.937053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9rf\" (UniqueName: \"kubernetes.io/projected/742e6d39-7bd2-4242-80e7-97885bb221ca-kube-api-access-fk9rf\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:02.937183 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:02.937079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742e6d39-7bd2-4242-80e7-97885bb221ca-manager-config\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.038446 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.038412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-metrics-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.038589 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.038449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.038589 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.038482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9rf\" (UniqueName: \"kubernetes.io/projected/742e6d39-7bd2-4242-80e7-97885bb221ca-kube-api-access-fk9rf\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.038589 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.038505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742e6d39-7bd2-4242-80e7-97885bb221ca-manager-config\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.039136 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.039104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/742e6d39-7bd2-4242-80e7-97885bb221ca-manager-config\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.041095 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.041072    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-metrics-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.041202 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.041107    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/742e6d39-7bd2-4242-80e7-97885bb221ca-cert\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.057853 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.057826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9rf\" (UniqueName: \"kubernetes.io/projected/742e6d39-7bd2-4242-80e7-97885bb221ca-kube-api-access-fk9rf\") pod \"lws-controller-manager-775bb6b8db-hqvcj\" (UID: \"742e6d39-7bd2-4242-80e7-97885bb221ca\") " pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.156074 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.155976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:03.317419 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.317383    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"]
Jul 23 15:57:03.320436 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:57:03.320409    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742e6d39_7bd2_4242_80e7_97885bb221ca.slice/crio-9e6a505925dd3017f4481d5e3b909f7e839bf6d8ac845f0e0a4e825ed306a1bd WatchSource:0}: Error finding container 9e6a505925dd3017f4481d5e3b909f7e839bf6d8ac845f0e0a4e825ed306a1bd: Status 404 returned error can't find the container with id 9e6a505925dd3017f4481d5e3b909f7e839bf6d8ac845f0e0a4e825ed306a1bd
Jul 23 15:57:03.880217 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:03.880179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj" event={"ID":"742e6d39-7bd2-4242-80e7-97885bb221ca","Type":"ContainerStarted","Data":"9e6a505925dd3017f4481d5e3b909f7e839bf6d8ac845f0e0a4e825ed306a1bd"}
Jul 23 15:57:05.892097 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:05.892060    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj" event={"ID":"742e6d39-7bd2-4242-80e7-97885bb221ca","Type":"ContainerStarted","Data":"fdd8da34287819a2eb6a291f49e214c3ab80a23b33c94bfccf370293ac80c9e5"}
Jul 23 15:57:05.892542 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:05.892188    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:16.898849 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:16.898811    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj"
Jul 23 15:57:16.961911 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:57:16.961857    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-775bb6b8db-hqvcj" podStartSLOduration=13.416693299 podStartE2EDuration="14.96184025s" totalImagesPullingTime="1.545146951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:05.994901461 +0000 UTC m=+407.118327249" watchObservedRunningTime="2026-07-23 15:57:16.96184025 +0000 UTC m=+418.085266025"
Jul 23 15:59:39.145742 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.145663    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 15:59:39.148764 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.148744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.151752 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.151729    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zdfd\""
Jul 23 15:59:39.151891 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.151848    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 15:59:39.154729 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.154703    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 15:59:39.154865 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.154753    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 15:59:39.166419 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.166390    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 15:59:39.187862 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.187824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 15:59:39.318291 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.318256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcrv\" (UniqueName: \"kubernetes.io/projected/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-kube-api-access-xjcrv\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.318484 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.318327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-config-file\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.418970 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.418877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcrv\" (UniqueName: \"kubernetes.io/projected/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-kube-api-access-xjcrv\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.418970 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.418956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-config-file\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.419547 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.419508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-config-file\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.428740 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.428714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcrv\" (UniqueName: \"kubernetes.io/projected/9ee7a983-0805-4ac4-991a-4d8b1d5b8b72-kube-api-access-xjcrv\") pod \"limitador-limitador-54d6d988d5-m8sqk\" (UID: \"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.458303 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.458269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:39.594693 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:39.594655    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 15:59:39.597637 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:59:39.597605    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee7a983_0805_4ac4_991a_4d8b1d5b8b72.slice/crio-307ccea55bb09da4220abc0f1cbea39dbffb6502b263ad05f0226005f6cfcf32 WatchSource:0}: Error finding container 307ccea55bb09da4220abc0f1cbea39dbffb6502b263ad05f0226005f6cfcf32: Status 404 returned error can't find the container with id 307ccea55bb09da4220abc0f1cbea39dbffb6502b263ad05f0226005f6cfcf32
Jul 23 15:59:40.006998 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.006961    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 15:59:40.011196 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.011175    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 15:59:40.013881 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.013857    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kr7p9\""
Jul 23 15:59:40.018852 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.018719    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 15:59:40.124726 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.124689    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mpqd\" (UniqueName: \"kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd\") pod \"authorino-75d556bd77-cqwv6\" (UID: \"7d243a30-a1f5-4b46-8362-04e329114fa3\") " pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 15:59:40.226279 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.225800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mpqd\" (UniqueName: \"kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd\") pod \"authorino-75d556bd77-cqwv6\" (UID: \"7d243a30-a1f5-4b46-8362-04e329114fa3\") " pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 15:59:40.238217 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.238183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mpqd\" (UniqueName: \"kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd\") pod \"authorino-75d556bd77-cqwv6\" (UID: \"7d243a30-a1f5-4b46-8362-04e329114fa3\") " pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 15:59:40.322205 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.322165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 15:59:40.493383 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.493345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 15:59:40.495853 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:40.495824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk" event={"ID":"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72","Type":"ContainerStarted","Data":"307ccea55bb09da4220abc0f1cbea39dbffb6502b263ad05f0226005f6cfcf32"}
Jul 23 15:59:40.497398 ip-10-0-130-166 kubenswrapper[2574]: W0723 15:59:40.497370    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d243a30_a1f5_4b46_8362_04e329114fa3.slice/crio-796dcf9a7571e1d476dadd304a886dff74406a2d01bc5df6fe031a6d4ab48b20 WatchSource:0}: Error finding container 796dcf9a7571e1d476dadd304a886dff74406a2d01bc5df6fe031a6d4ab48b20: Status 404 returned error can't find the container with id 796dcf9a7571e1d476dadd304a886dff74406a2d01bc5df6fe031a6d4ab48b20
Jul 23 15:59:41.501153 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:41.501108    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqwv6" event={"ID":"7d243a30-a1f5-4b46-8362-04e329114fa3","Type":"ContainerStarted","Data":"796dcf9a7571e1d476dadd304a886dff74406a2d01bc5df6fe031a6d4ab48b20"}
Jul 23 15:59:42.508781 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:42.508692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk" event={"ID":"9ee7a983-0805-4ac4-991a-4d8b1d5b8b72","Type":"ContainerStarted","Data":"61ca038251b0ca22909b184dcec6e484875ee820489e2058f79a16b85bed2089"}
Jul 23 15:59:42.509239 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:42.508839    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 15:59:42.527602 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:42.527538    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk" podStartSLOduration=0.894648592 podStartE2EDuration="3.527503394s" totalImagesPullingTime="2.632854802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:42.52698607 +0000 UTC m=+563.650411840" watchObservedRunningTime="2026-07-23 15:59:42.527503394 +0000 UTC m=+563.650929174"
Jul 23 15:59:45.523402 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:45.523369    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqwv6" event={"ID":"7d243a30-a1f5-4b46-8362-04e329114fa3","Type":"ContainerStarted","Data":"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"}
Jul 23 15:59:45.540218 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:45.540160    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cqwv6" podStartSLOduration=2.272916553 podStartE2EDuration="6.540133017s" totalImagesPullingTime="4.267216464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:45.539839062 +0000 UTC m=+566.663264838" watchObservedRunningTime="2026-07-23 15:59:45.540133017 +0000 UTC m=+566.663558853"
Jul 23 15:59:53.514690 ip-10-0-130-166 kubenswrapper[2574]: I0723 15:59:53.514654    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"
Jul 23 16:00:20.750048 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:20.750010    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 16:00:20.750601 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:20.750241    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cqwv6" podUID="7d243a30-a1f5-4b46-8362-04e329114fa3" containerName="authorino" containerID="cri-o://c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e" gracePeriod=30
Jul 23 16:00:20.990568 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:20.990542    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 16:00:21.025285 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.025195    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mpqd\" (UniqueName: \"kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd\") pod \"7d243a30-a1f5-4b46-8362-04e329114fa3\" (UID: \"7d243a30-a1f5-4b46-8362-04e329114fa3\") "
Jul 23 16:00:21.027466 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.027434    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd" (OuterVolumeSpecName: "kube-api-access-2mpqd") pod "7d243a30-a1f5-4b46-8362-04e329114fa3" (UID: "7d243a30-a1f5-4b46-8362-04e329114fa3"). InnerVolumeSpecName "kube-api-access-2mpqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:00:21.126225 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.126184    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mpqd\" (UniqueName: \"kubernetes.io/projected/7d243a30-a1f5-4b46-8362-04e329114fa3-kube-api-access-2mpqd\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:00:21.667170 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.667075    2574 generic.go:356] "Generic (PLEG): container finished" podID="7d243a30-a1f5-4b46-8362-04e329114fa3" containerID="c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e" exitCode=0
Jul 23 16:00:21.667170 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.667127    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cqwv6"
Jul 23 16:00:21.667170 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.667154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqwv6" event={"ID":"7d243a30-a1f5-4b46-8362-04e329114fa3","Type":"ContainerDied","Data":"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"}
Jul 23 16:00:21.667418 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.667194    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cqwv6" event={"ID":"7d243a30-a1f5-4b46-8362-04e329114fa3","Type":"ContainerDied","Data":"796dcf9a7571e1d476dadd304a886dff74406a2d01bc5df6fe031a6d4ab48b20"}
Jul 23 16:00:21.667418 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.667212    2574 scope.go:117] "RemoveContainer" containerID="c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"
Jul 23 16:00:21.675415 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.675400    2574 scope.go:117] "RemoveContainer" containerID="c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"
Jul 23 16:00:21.675758 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:00:21.675727    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e\": container with ID starting with c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e not found: ID does not exist" containerID="c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"
Jul 23 16:00:21.675802 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.675768    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e"} err="failed to get container status \"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e\": rpc error: code = NotFound desc = could not find container \"c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e\": container with ID starting with c71ce879f107651266820ca7f04c680ce3c9085c9a112163e5ecc6db320bc87e not found: ID does not exist"
Jul 23 16:00:21.683507 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.683473    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 16:00:21.687138 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:21.687111    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cqwv6"]
Jul 23 16:00:23.392801 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:00:23.392758    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d243a30-a1f5-4b46-8362-04e329114fa3" path="/var/lib/kubelet/pods/7d243a30-a1f5-4b46-8362-04e329114fa3/volumes"
Jul 23 16:01:01.497490 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:01:01.497445    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:01:44.211684 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:01:44.211643    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:00.788515 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:00.788467    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:11.508228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:11.508142    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:16.842747 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:16.842707    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:20.796641 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.796606    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"]
Jul 23 16:02:20.797023 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.796884    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d243a30-a1f5-4b46-8362-04e329114fa3" containerName="authorino"
Jul 23 16:02:20.797023 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.796894    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d243a30-a1f5-4b46-8362-04e329114fa3" containerName="authorino"
Jul 23 16:02:20.797023 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.796943    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d243a30-a1f5-4b46-8362-04e329114fa3" containerName="authorino"
Jul 23 16:02:20.798876 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.798856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.803034 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.803009    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m7bzl\""
Jul 23 16:02:20.803200 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.803058    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 16:02:20.803200 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.803067    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 16:02:20.803200 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.803119    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 16:02:20.812120 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.812095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"]
Jul 23 16:02:20.838505 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.838505 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.838745 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.838745 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cl8w\" (UniqueName: \"kubernetes.io/projected/b921fcae-af2a-4706-8b7f-bef0117e9e62-kube-api-access-9cl8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.838745 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838596    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b921fcae-af2a-4706-8b7f-bef0117e9e62-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.838745 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.838616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939040 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939040 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939299 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939061    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cl8w\" (UniqueName: \"kubernetes.io/projected/b921fcae-af2a-4706-8b7f-bef0117e9e62-kube-api-access-9cl8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939299 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b921fcae-af2a-4706-8b7f-bef0117e9e62-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939299 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939299 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939495 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939594 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.939713 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.939695    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.941619 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.941596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b921fcae-af2a-4706-8b7f-bef0117e9e62-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.941772 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.941755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b921fcae-af2a-4706-8b7f-bef0117e9e62-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:20.957344 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:20.957304    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cl8w\" (UniqueName: \"kubernetes.io/projected/b921fcae-af2a-4706-8b7f-bef0117e9e62-kube-api-access-9cl8w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zgvd4\" (UID: \"b921fcae-af2a-4706-8b7f-bef0117e9e62\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:21.109306 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:21.109269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:21.259108 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:21.259068    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"]
Jul 23 16:02:21.262109 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:02:21.262078    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb921fcae_af2a_4706_8b7f_bef0117e9e62.slice/crio-496b21120dbf1da985d31fcc1e7f535f6a83b275e1a43d6ee52406b7b4524e97 WatchSource:0}: Error finding container 496b21120dbf1da985d31fcc1e7f535f6a83b275e1a43d6ee52406b7b4524e97: Status 404 returned error can't find the container with id 496b21120dbf1da985d31fcc1e7f535f6a83b275e1a43d6ee52406b7b4524e97
Jul 23 16:02:21.263587 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:21.263567    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:02:22.134888 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:22.134848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4" event={"ID":"b921fcae-af2a-4706-8b7f-bef0117e9e62","Type":"ContainerStarted","Data":"496b21120dbf1da985d31fcc1e7f535f6a83b275e1a43d6ee52406b7b4524e97"}
Jul 23 16:02:23.140760 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:23.140717    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4" event={"ID":"b921fcae-af2a-4706-8b7f-bef0117e9e62","Type":"ContainerStarted","Data":"6d393f04207428a4329ae052d29f1e1bcc3b18ec6a308334c2805c6b7711d983"}
Jul 23 16:02:23.164239 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:23.164185    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4" podStartSLOduration=2.054830979 podStartE2EDuration="3.164170091s" totalImagesPullingTime="1.109339112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:02:23.163672399 +0000 UTC m=+724.287098177" watchObservedRunningTime="2026-07-23 16:02:23.164170091 +0000 UTC m=+724.287595866"
Jul 23 16:02:23.687178 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:23.687142    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:31.109642 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:31.109585    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:31.110063 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:31.109690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:31.122425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:31.122391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:31.186204 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:31.186176    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zgvd4"
Jul 23 16:02:37.519732 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.519680    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"]
Jul 23 16:02:37.526596 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.526567    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.529576 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.529553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 16:02:37.538553 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.538508    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"]
Jul 23 16:02:37.668029 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.667992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.668029 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.668034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.668258 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.668062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74215a16-fc21-43b1-84d3-4d68eb991b78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.668258 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.668135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.668258 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.668170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.668258 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.668198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8g8k\" (UniqueName: \"kubernetes.io/projected/74215a16-fc21-43b1-84d3-4d68eb991b78-kube-api-access-k8g8k\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.768867 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.768821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74215a16-fc21-43b1-84d3-4d68eb991b78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769062 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.768883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769062 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769062 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8g8k\" (UniqueName: \"kubernetes.io/projected/74215a16-fc21-43b1-84d3-4d68eb991b78-kube-api-access-k8g8k\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769301 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769301 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769301 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769462 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.769513 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.769493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.771326 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.771258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74215a16-fc21-43b1-84d3-4d68eb991b78-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.771489 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.771468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74215a16-fc21-43b1-84d3-4d68eb991b78-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.777877 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.777855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8g8k\" (UniqueName: \"kubernetes.io/projected/74215a16-fc21-43b1-84d3-4d68eb991b78-kube-api-access-k8g8k\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2\" (UID: \"74215a16-fc21-43b1-84d3-4d68eb991b78\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.835785 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.835751    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:37.979167 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:37.979140    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"]
Jul 23 16:02:37.981603 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:02:37.981573    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74215a16_fc21_43b1_84d3_4d68eb991b78.slice/crio-3378760101ad386a1517e53fb556bd8023f1f2329d859a95a91e85241ae696af WatchSource:0}: Error finding container 3378760101ad386a1517e53fb556bd8023f1f2329d859a95a91e85241ae696af: Status 404 returned error can't find the container with id 3378760101ad386a1517e53fb556bd8023f1f2329d859a95a91e85241ae696af
Jul 23 16:02:38.204700 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:38.204662    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2" event={"ID":"74215a16-fc21-43b1-84d3-4d68eb991b78","Type":"ContainerStarted","Data":"3378760101ad386a1517e53fb556bd8023f1f2329d859a95a91e85241ae696af"}
Jul 23 16:02:39.210770 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:39.210733    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2" event={"ID":"74215a16-fc21-43b1-84d3-4d68eb991b78","Type":"ContainerStarted","Data":"825bcde8a14c4ec9df8fff25ed6c76b9dbabfa21b663b8d5c48344e0b8ec9c9e"}
Jul 23 16:02:39.236111 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:39.236061    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2" podStartSLOduration=1.84948281 podStartE2EDuration="2.236042457s" totalImagesPullingTime="386.559647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:02:39.234926212 +0000 UTC m=+740.358352008" watchObservedRunningTime="2026-07-23 16:02:39.236042457 +0000 UTC m=+740.359468231"
Jul 23 16:02:39.990309 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:39.990265    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:02:47.836808 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:47.836766    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:47.836808 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:47.836819    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:47.849198 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:47.849164    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:02:48.259490 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:02:48.259394    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2"
Jul 23 16:03:35.070131 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.070093    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76d9d7c949-npwnw"]
Jul 23 16:03:35.073463 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.073445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.077226 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.077205    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 16:03:35.077226 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.077220    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kr7p9\""
Jul 23 16:03:35.080674 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.080591    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d9d7c949-npwnw"]
Jul 23 16:03:35.136227 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.136191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b75tw\" (UniqueName: \"kubernetes.io/projected/e7bb0efd-f777-4306-be9e-fbe3f818ea23-kube-api-access-b75tw\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.136227 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.136229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7bb0efd-f777-4306-be9e-fbe3f818ea23-tls-cert\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.236848 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.236814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b75tw\" (UniqueName: \"kubernetes.io/projected/e7bb0efd-f777-4306-be9e-fbe3f818ea23-kube-api-access-b75tw\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.236848 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.236850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7bb0efd-f777-4306-be9e-fbe3f818ea23-tls-cert\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.239404 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.239378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7bb0efd-f777-4306-be9e-fbe3f818ea23-tls-cert\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.246028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.245999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b75tw\" (UniqueName: \"kubernetes.io/projected/e7bb0efd-f777-4306-be9e-fbe3f818ea23-kube-api-access-b75tw\") pod \"authorino-76d9d7c949-npwnw\" (UID: \"e7bb0efd-f777-4306-be9e-fbe3f818ea23\") " pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.383902 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.383869    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d9d7c949-npwnw"
Jul 23 16:03:35.524101 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:35.524067    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d9d7c949-npwnw"]
Jul 23 16:03:35.528092 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:03:35.528058    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7bb0efd_f777_4306_be9e_fbe3f818ea23.slice/crio-68f995fe208196284d5689cc281c9eb6f999afb140de5d60fdb254ed9a660acb WatchSource:0}: Error finding container 68f995fe208196284d5689cc281c9eb6f999afb140de5d60fdb254ed9a660acb: Status 404 returned error can't find the container with id 68f995fe208196284d5689cc281c9eb6f999afb140de5d60fdb254ed9a660acb
Jul 23 16:03:36.442932 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:36.442896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d9d7c949-npwnw" event={"ID":"e7bb0efd-f777-4306-be9e-fbe3f818ea23","Type":"ContainerStarted","Data":"caf42985f2c11f8b85145ba6971c11f5838eeb96cc8fce0fd238e9bb6e286630"}
Jul 23 16:03:36.443311 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:36.442943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d9d7c949-npwnw" event={"ID":"e7bb0efd-f777-4306-be9e-fbe3f818ea23","Type":"ContainerStarted","Data":"68f995fe208196284d5689cc281c9eb6f999afb140de5d60fdb254ed9a660acb"}
Jul 23 16:03:36.461484 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:03:36.461430    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76d9d7c949-npwnw" podStartSLOduration=1.013781606 podStartE2EDuration="1.461412215s" totalImagesPullingTime="447.630609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:03:36.460340276 +0000 UTC m=+797.583766051" watchObservedRunningTime="2026-07-23 16:03:36.461412215 +0000 UTC m=+797.584837990"
Jul 23 16:04:04.991813 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:04:04.991770    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:04:14.390535 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:04:14.390484    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:04:26.003256 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:04:26.003217    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:06:08.688440 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:06:08.688403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:06:19.593441 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:06:19.593403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:06:57.492591 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:06:57.492558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:06.895337 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:06.895298    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:15.595516 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:15.595477    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:26.883862 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:26.883825    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:36.295817 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:36.295778    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:47.995671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:47.995633    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:07:59.399750 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:07:59.399716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:08:09.722715 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:08:09.722629    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:08:31.598602 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:08:31.598566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:08:44.289543 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:08:44.289492    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:09:08.006871 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:09:08.006836    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:09:18.595315 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:09:18.595280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:09:34.586242 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:09:34.586213    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:09:43.889398 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:09:43.889315    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:09:53.786219 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:09:53.786179    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:10:03.588284 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:10:03.588231    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:10:12.991320 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:10:12.991283    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:12:02.588158 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:12:02.588120    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:12:11.697304 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:12:11.697268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:12:28.886229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:12:28.886192    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:12:40.990327 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:12:40.990239    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:12:50.887770 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:12:50.887725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:00.247050 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:00.247008    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:09.393411 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:09.393376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:21.084924 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:21.084872    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:32.185792 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:32.185758    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:40.903310 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:40.903272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:13:52.001247 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:13:52.001205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:14:16.213219 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:16.213136    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:14:23.993466 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:23.993433    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:14:23.996481 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:23.996466    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:23.999182 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:23.999158    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-56f9f5aa-kserve-self-signed-certs\""
Jul 23 16:14:24.004291 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.004266    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:14:24.016078 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.016046    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:14:24.094328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.094510 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cncvq\" (UniqueName: \"kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.094510 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.094510 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.094510 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094414    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.094510 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.094484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.195898 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.195857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196090 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.195910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cncvq\" (UniqueName: \"kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196090 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.195967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196090 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.195991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196090 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.196017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196090 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.196043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196352 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.196328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196460 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.196437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.196730 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.196706    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.198184 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.198159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.198535 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.198507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.204744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.204723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cncvq\" (UniqueName: \"kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq\") pod \"e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") " pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.305807 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.305726    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:24.452697 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:24.452585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:14:24.456113 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:14:24.456080    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod890fc88e_8a69_4080_af11_89191f1ee6f7.slice/crio-0d5bb05411755bb1c3c41668b09170e7dfe04b77f04e97801e2ca4315db821cc WatchSource:0}: Error finding container 0d5bb05411755bb1c3c41668b09170e7dfe04b77f04e97801e2ca4315db821cc: Status 404 returned error can't find the container with id 0d5bb05411755bb1c3c41668b09170e7dfe04b77f04e97801e2ca4315db821cc
Jul 23 16:14:25.099126 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:25.099092    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" event={"ID":"890fc88e-8a69-4080-af11-89191f1ee6f7","Type":"ContainerStarted","Data":"3e1352627c9ad180aad5a288ed155a60b7425ec1d36f6f51b520d09122a2f53a"}
Jul 23 16:14:25.099585 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:25.099137    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" event={"ID":"890fc88e-8a69-4080-af11-89191f1ee6f7","Type":"ContainerStarted","Data":"0d5bb05411755bb1c3c41668b09170e7dfe04b77f04e97801e2ca4315db821cc"}
Jul 23 16:14:25.119675 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:25.119607    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" podStartSLOduration=2.119586331 podStartE2EDuration="2.119586331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:14:25.118195814 +0000 UTC m=+1446.241621587" watchObservedRunningTime="2026-07-23 16:14:25.119586331 +0000 UTC m=+1446.243012108"
Jul 23 16:14:34.306380 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:34.306270    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:34.306380 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:34.306340    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:34.318925 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:34.318888    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:35.150423 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:35.150392    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:14:36.783306 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:36.783264    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:14:52.594054 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.594018    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:14:52.597237 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.597220    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.600066 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.600045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-56f9f5aa-kserve-self-signed-certs\""
Jul 23 16:14:52.607681 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.607656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:14:52.749785 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749746    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.749785 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.749995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.749995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749875    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.749995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.750084 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.749996    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfc2n\" (UniqueName: \"kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850741 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850741 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfc2n\" (UniqueName: \"kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850741 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850880 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850880 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850863    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.850968 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.850907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.852790 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.852770    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.853042 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.853024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.859807 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.859779    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfc2n\" (UniqueName: \"kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n\") pod \"e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") " pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:52.906659 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:52.906611    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:14:53.041876 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:53.041849    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:14:53.044551 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:14:53.044470    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77b35aa5_aed4_44bb_b519_ee911c7b88fc.slice/crio-9f5b2ef754447055f5b6986e5ea42a91faff3f12465593c18cda626fd91ce102 WatchSource:0}: Error finding container 9f5b2ef754447055f5b6986e5ea42a91faff3f12465593c18cda626fd91ce102: Status 404 returned error can't find the container with id 9f5b2ef754447055f5b6986e5ea42a91faff3f12465593c18cda626fd91ce102
Jul 23 16:14:53.213284 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:53.213250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" event={"ID":"77b35aa5-aed4-44bb-b519-ee911c7b88fc","Type":"ContainerStarted","Data":"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"}
Jul 23 16:14:53.213284 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:53.213287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" event={"ID":"77b35aa5-aed4-44bb-b519-ee911c7b88fc","Type":"ContainerStarted","Data":"9f5b2ef754447055f5b6986e5ea42a91faff3f12465593c18cda626fd91ce102"}
Jul 23 16:14:53.233091 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:53.233034    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" podStartSLOduration=1.233016515 podStartE2EDuration="1.233016515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:14:53.231276948 +0000 UTC m=+1474.354702724" watchObservedRunningTime="2026-07-23 16:14:53.233016515 +0000 UTC m=+1474.356442290"
Jul 23 16:14:56.401155 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:14:56.401116    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:15:02.906913 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:02.906859    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:02.906913 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:02.906918    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:02.919431 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:02.919401    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:03.264560 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:03.264459    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:21.241727 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:21.241688    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:15:22.301559 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:22.301513    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:15:25.191394 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:25.191354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:15:36.262999 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.262953    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" podUID="890fc88e-8a69-4080-af11-89191f1ee6f7" containerName="main" containerID="cri-o://3e1352627c9ad180aad5a288ed155a60b7425ec1d36f6f51b520d09122a2f53a" gracePeriod=45
Jul 23 16:15:36.393347 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.393310    2574 generic.go:356] "Generic (PLEG): container finished" podID="890fc88e-8a69-4080-af11-89191f1ee6f7" containerID="3e1352627c9ad180aad5a288ed155a60b7425ec1d36f6f51b520d09122a2f53a" exitCode=0
Jul 23 16:15:36.393560 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.393390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" event={"ID":"890fc88e-8a69-4080-af11-89191f1ee6f7","Type":"ContainerDied","Data":"3e1352627c9ad180aad5a288ed155a60b7425ec1d36f6f51b520d09122a2f53a"}
Jul 23 16:15:36.510182 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.510155    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:15:36.625908 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.625874    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.625908 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.625918    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.626165 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.625950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.626165 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.625967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.626165 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626013    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cncvq\" (UniqueName: \"kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.626165 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626070    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm\") pod \"890fc88e-8a69-4080-af11-89191f1ee6f7\" (UID: \"890fc88e-8a69-4080-af11-89191f1ee6f7\") "
Jul 23 16:15:36.626365 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626176    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:36.626365 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626279    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:36.626365 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626289    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home" (OuterVolumeSpecName: "home") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:36.626365 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.626305    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:36.628334 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.628310    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:15:36.628430 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.628323    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq" (OuterVolumeSpecName: "kube-api-access-cncvq") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "kube-api-access-cncvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:15:36.628430 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.628376    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm" (OuterVolumeSpecName: "dshm") pod "890fc88e-8a69-4080-af11-89191f1ee6f7" (UID: "890fc88e-8a69-4080-af11-89191f1ee6f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:36.727682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.727640    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:36.727682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.727672    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/890fc88e-8a69-4080-af11-89191f1ee6f7-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:36.727682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.727681    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cncvq\" (UniqueName: \"kubernetes.io/projected/890fc88e-8a69-4080-af11-89191f1ee6f7-kube-api-access-cncvq\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:36.727682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.727689    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:36.727943 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:36.727700    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/890fc88e-8a69-4080-af11-89191f1ee6f7-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.195320 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.193512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:15:37.321820 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.321748    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" podUID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" containerName="main" containerID="cri-o://b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca" gracePeriod=45
Jul 23 16:15:37.399462 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.399433    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"
Jul 23 16:15:37.399462 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.399451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw" event={"ID":"890fc88e-8a69-4080-af11-89191f1ee6f7","Type":"ContainerDied","Data":"0d5bb05411755bb1c3c41668b09170e7dfe04b77f04e97801e2ca4315db821cc"}
Jul 23 16:15:37.399762 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.399500    2574 scope.go:117] "RemoveContainer" containerID="3e1352627c9ad180aad5a288ed155a60b7425ec1d36f6f51b520d09122a2f53a"
Jul 23 16:15:37.424829 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.424793    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:15:37.430440 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.430400    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-56f9f5aa-kserve-648d5b8cd7-gldfw"]
Jul 23 16:15:37.577591 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.577563    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:37.734515 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734479    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfc2n\" (UniqueName: \"kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734562    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734584    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734605    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734621    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734744 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734655    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache\") pod \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\" (UID: \"77b35aa5-aed4-44bb-b519-ee911c7b88fc\") "
Jul 23 16:15:37.734993 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734903    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:37.734993 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.734919    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home" (OuterVolumeSpecName: "home") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:37.735061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.735015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:37.736779 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.736753    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:15:37.736885 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.736777    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm" (OuterVolumeSpecName: "dshm") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:15:37.736885 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.736797    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n" (OuterVolumeSpecName: "kube-api-access-pfc2n") pod "77b35aa5-aed4-44bb-b519-ee911c7b88fc" (UID: "77b35aa5-aed4-44bb-b519-ee911c7b88fc"). InnerVolumeSpecName "kube-api-access-pfc2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:15:37.836254 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836217    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfc2n\" (UniqueName: \"kubernetes.io/projected/77b35aa5-aed4-44bb-b519-ee911c7b88fc-kube-api-access-pfc2n\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.836254 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836256    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.836473 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836276    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.836473 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836288    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.836473 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836301    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:37.836473 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:37.836314    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77b35aa5-aed4-44bb-b519-ee911c7b88fc-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:15:38.406169 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.406133    2574 generic.go:356] "Generic (PLEG): container finished" podID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" containerID="b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca" exitCode=0
Jul 23 16:15:38.406671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.406181    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"
Jul 23 16:15:38.406671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.406190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" event={"ID":"77b35aa5-aed4-44bb-b519-ee911c7b88fc","Type":"ContainerDied","Data":"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"}
Jul 23 16:15:38.406671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.406228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds" event={"ID":"77b35aa5-aed4-44bb-b519-ee911c7b88fc","Type":"ContainerDied","Data":"9f5b2ef754447055f5b6986e5ea42a91faff3f12465593c18cda626fd91ce102"}
Jul 23 16:15:38.406671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.406251    2574 scope.go:117] "RemoveContainer" containerID="b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"
Jul 23 16:15:38.415104 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.415087    2574 scope.go:117] "RemoveContainer" containerID="b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"
Jul 23 16:15:38.415412 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:15:38.415394    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca\": container with ID starting with b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca not found: ID does not exist" containerID="b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"
Jul 23 16:15:38.415497 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.415422    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca"} err="failed to get container status \"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca\": rpc error: code = NotFound desc = could not find container \"b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca\": container with ID starting with b9b28fb1789f79be941082f28ac865426790f63578fb321320d91f5a0babf2ca not found: ID does not exist"
Jul 23 16:15:38.432515 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.432484    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:15:38.437579 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:38.437551    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-56f9f5aa-kserve-6765d68f75-6dfds"]
Jul 23 16:15:39.393624 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:39.393587    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" path="/var/lib/kubelet/pods/77b35aa5-aed4-44bb-b519-ee911c7b88fc/volumes"
Jul 23 16:15:39.393965 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:39.393951    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="890fc88e-8a69-4080-af11-89191f1ee6f7" path="/var/lib/kubelet/pods/890fc88e-8a69-4080-af11-89191f1ee6f7/volumes"
Jul 23 16:15:47.509137 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:15:47.509096    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:00.147277 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:00.147243    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:14.991375 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:14.991330    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:24.397589 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:24.397550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:33.491087 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:33.491044    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:41.493196 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:41.493149    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:16:52.791758 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:16:52.791716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:05.897821 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:05.897782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:15.314423 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:15.314338    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:25.296636 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:25.296591    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:35.187205 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:35.187164    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:47.787456 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:47.787417    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:17:56.892285 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:17:56.892246    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:18:10.109370 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:18:10.109333    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:18:22.889284 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:18:22.889242    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:18:32.293713 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:18:32.293683    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:18:45.188309 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:18:45.188224    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:18:55.993485 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:18:55.993449    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:19:05.191754 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:19:05.191716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:19:13.689788 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:19:13.689749    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:19:50.491946 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:19:50.491910    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:20:01.893066 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:20:01.893022    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:20:33.595651 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:20:33.595616    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:20:45.094390 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:20:45.094348    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:21:18.290488 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:21:18.290452    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:21:29.695925 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:21:29.695886    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:22:02.092464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:22:02.092426    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:23:29.788370 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:23:29.788267    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:23:39.987669 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:23:39.987626    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:23:51.392876 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:23:51.392838    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:23:59.697561 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:23:59.697506    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:24:15.883241 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:15.883195    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:24:54.191823 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:54.191784    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:24:56.271653 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271612    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271889    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="890fc88e-8a69-4080-af11-89191f1ee6f7" containerName="main"
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271900    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="890fc88e-8a69-4080-af11-89191f1ee6f7" containerName="main"
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271915    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" containerName="main"
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271921    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" containerName="main"
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271972    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b35aa5-aed4-44bb-b519-ee911c7b88fc" containerName="main"
Jul 23 16:24:56.272061 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.271983    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="890fc88e-8a69-4080-af11-89191f1ee6f7" containerName="main"
Jul 23 16:24:56.274771 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.274751    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.277437 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.277411    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5000bdcd\"/\"default-dockercfg-g7dwf\""
Jul 23 16:24:56.277602 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.277411    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5000bdcd\"/\"kube-root-ca.crt\""
Jul 23 16:24:56.278618 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.278601    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5000bdcd\"/\"openshift-service-ca.crt\""
Jul 23 16:24:56.278721 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.278704    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5000bdcd\"/\"e2e-lifecycle-model-5000bdcd-kserve-self-signed-certs\""
Jul 23 16:24:56.283689 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.283664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:24:56.395690 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ncs\" (UniqueName: \"kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.395884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395697    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.395884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.395884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.395884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.395884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.395864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.496995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.496958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ncs\" (UniqueName: \"kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.496995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497199    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497403 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497379    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497507 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.497639 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.497622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.499303 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.499278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.499621 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.499604    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.508681 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.508653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ncs\" (UniqueName: \"kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs\") pod \"e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") " pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.585749 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.585711    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:24:56.721634 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:56.721573    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:24:56.723885 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:24:56.723850    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9817d0eb_bfde_4517_a6be_e7448f958260.slice/crio-5f8d1491b8a5874745b555ce64af8c4333bd88a6310233def48b7c4397023074 WatchSource:0}: Error finding container 5f8d1491b8a5874745b555ce64af8c4333bd88a6310233def48b7c4397023074: Status 404 returned error can't find the container with id 5f8d1491b8a5874745b555ce64af8c4333bd88a6310233def48b7c4397023074
Jul 23 16:24:57.708836 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:57.708800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" event={"ID":"9817d0eb-bfde-4517-a6be-e7448f958260","Type":"ContainerStarted","Data":"a3d5261471ca27e8af35893154d17ac079b73a4c5663cd3111490576bdabb6ef"}
Jul 23 16:24:57.708836 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:57.708841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" event={"ID":"9817d0eb-bfde-4517-a6be-e7448f958260","Type":"ContainerStarted","Data":"5f8d1491b8a5874745b555ce64af8c4333bd88a6310233def48b7c4397023074"}
Jul 23 16:24:57.727396 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:24:57.727335    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" podStartSLOduration=1.727316626 podStartE2EDuration="1.727316626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:57.725813008 +0000 UTC m=+2078.849238784" watchObservedRunningTime="2026-07-23 16:24:57.727316626 +0000 UTC m=+2078.850742400"
Jul 23 16:25:06.586028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:06.585984    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:25:06.586028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:06.586041    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:25:06.594046 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:06.594011    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:25:06.598897 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:06.598868    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:25:06.756286 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:06.756255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:25:18.794309 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:18.794274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:25:39.594692 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:39.594654    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:25:50.104148 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:50.104111    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:25:52.853250 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:25:52.853210    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:26:07.873454 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:07.873390    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" podUID="9817d0eb-bfde-4517-a6be-e7448f958260" containerName="main" containerID="cri-o://a3d5261471ca27e8af35893154d17ac079b73a4c5663cd3111490576bdabb6ef" gracePeriod=45
Jul 23 16:26:07.999412 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:07.999375    2574 generic.go:356] "Generic (PLEG): container finished" podID="9817d0eb-bfde-4517-a6be-e7448f958260" containerID="a3d5261471ca27e8af35893154d17ac079b73a4c5663cd3111490576bdabb6ef" exitCode=0
Jul 23 16:26:07.999592 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:07.999442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" event={"ID":"9817d0eb-bfde-4517-a6be-e7448f958260","Type":"ContainerDied","Data":"a3d5261471ca27e8af35893154d17ac079b73a4c5663cd3111490576bdabb6ef"}
Jul 23 16:26:08.117409 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.117384    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:26:08.180275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180181    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180225    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180257    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180547 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180316    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5ncs\" (UniqueName: \"kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180547 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180354    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180547 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180379    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir\") pod \"9817d0eb-bfde-4517-a6be-e7448f958260\" (UID: \"9817d0eb-bfde-4517-a6be-e7448f958260\") "
Jul 23 16:26:08.180547 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180513    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home" (OuterVolumeSpecName: "home") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:26:08.180742 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180575    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache" (OuterVolumeSpecName: "model-cache") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:26:08.180742 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180625    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:08.180742 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180640    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:08.180904 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.180777    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:26:08.182731 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.182700    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm" (OuterVolumeSpecName: "dshm") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:26:08.182846 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.182785    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:26:08.182887 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.182859    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs" (OuterVolumeSpecName: "kube-api-access-q5ncs") pod "9817d0eb-bfde-4517-a6be-e7448f958260" (UID: "9817d0eb-bfde-4517-a6be-e7448f958260"). InnerVolumeSpecName "kube-api-access-q5ncs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:26:08.282074 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.282034    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5ncs\" (UniqueName: \"kubernetes.io/projected/9817d0eb-bfde-4517-a6be-e7448f958260-kube-api-access-q5ncs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:08.282074 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.282060    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9817d0eb-bfde-4517-a6be-e7448f958260-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:08.282074 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.282071    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:08.282074 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:08.282078    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9817d0eb-bfde-4517-a6be-e7448f958260-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:26:09.005109 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.005078    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2" event={"ID":"9817d0eb-bfde-4517-a6be-e7448f958260","Type":"ContainerDied","Data":"5f8d1491b8a5874745b555ce64af8c4333bd88a6310233def48b7c4397023074"}
Jul 23 16:26:09.005586 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.005095    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"
Jul 23 16:26:09.005586 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.005129    2574 scope.go:117] "RemoveContainer" containerID="a3d5261471ca27e8af35893154d17ac079b73a4c5663cd3111490576bdabb6ef"
Jul 23 16:26:09.028705 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.028674    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:26:09.031094 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.031070    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5000bdcd/e2e-lifecycle-model-5000bdcd-kserve-5c7d444df9-kpdn2"]
Jul 23 16:26:09.393706 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:09.393675    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9817d0eb-bfde-4517-a6be-e7448f958260" path="/var/lib/kubelet/pods/9817d0eb-bfde-4517-a6be-e7448f958260/volumes"
Jul 23 16:26:53.792902 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:26:53.792867    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:27:03.091274 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:27:03.091240    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:27:57.983954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:27:57.983916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:28:09.385622 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.385586    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:28:09.495384 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.495351    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:28:09.495686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.495672    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9817d0eb-bfde-4517-a6be-e7448f958260" containerName="main"
Jul 23 16:28:09.495686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.495687    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9817d0eb-bfde-4517-a6be-e7448f958260" containerName="main"
Jul 23 16:28:09.495770 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.495738    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9817d0eb-bfde-4517-a6be-e7448f958260" containerName="main"
Jul 23 16:28:09.498619 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.498594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.502646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.502618    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-652934\"/\"test-model-652934-kserve-self-signed-certs\""
Jul 23 16:28:09.502646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.502642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-652934\"/\"kube-root-ca.crt\""
Jul 23 16:28:09.502823 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.502619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-652934\"/\"default-dockercfg-zrfpg\""
Jul 23 16:28:09.502823 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.502619    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-652934\"/\"openshift-service-ca.crt\""
Jul 23 16:28:09.509026 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.509001    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:28:09.577244 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.577425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.577425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.577425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.577425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.577425 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.577397    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-488q8\" (UniqueName: \"kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678454 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678454 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678440    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678454 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678734 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678734 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678734 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-488q8\" (UniqueName: \"kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678924 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678893    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.678991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.678977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.680740 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.680717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.680964 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.680946    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.692428 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.692400    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-488q8\" (UniqueName: \"kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8\") pod \"test-model-652934-kserve-6d7b774dc-fvjqj\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") " pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.808129 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.808090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:09.959925 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:28:09.959896    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod203d3833_da2f_47ac_b6b2_1cc243ddb8dd.slice/crio-76a592000a265df21a568e01fbb519a5589bdf90ea54937312d23eb271aaccfd WatchSource:0}: Error finding container 76a592000a265df21a568e01fbb519a5589bdf90ea54937312d23eb271aaccfd: Status 404 returned error can't find the container with id 76a592000a265df21a568e01fbb519a5589bdf90ea54937312d23eb271aaccfd
Jul 23 16:28:09.960439 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:09.960415    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:28:10.516916 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:10.516878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" event={"ID":"203d3833-da2f-47ac-b6b2-1cc243ddb8dd","Type":"ContainerStarted","Data":"70cd6b2533904ec1e918fd98bae233ff52049f1ada4e1a3d6a876d41eff3abff"}
Jul 23 16:28:10.516916 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:10.516921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" event={"ID":"203d3833-da2f-47ac-b6b2-1cc243ddb8dd","Type":"ContainerStarted","Data":"76a592000a265df21a568e01fbb519a5589bdf90ea54937312d23eb271aaccfd"}
Jul 23 16:28:10.536729 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:10.536675    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" podStartSLOduration=1.536659138 podStartE2EDuration="1.536659138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:28:10.53622533 +0000 UTC m=+2271.659651116" watchObservedRunningTime="2026-07-23 16:28:10.536659138 +0000 UTC m=+2271.660084912"
Jul 23 16:28:19.700120 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:19.700085    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:28:19.808621 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:19.808582    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:19.808621 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:19.808619    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:19.821228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:19.821194    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:20.574330 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:20.574300    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:28:50.177315 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.177277    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:28:50.180463 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.180443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.184569 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.184544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d1deea\"/\"default-dockercfg-2rhbz\""
Jul 23 16:28:50.184711 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.184601    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d1deea\"/\"kube-root-ca.crt\""
Jul 23 16:28:50.184711 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.184649    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d1deea\"/\"openshift-service-ca.crt\""
Jul 23 16:28:50.184711 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.184542    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d1deea\"/\"test-model-d1deea-kserve-self-signed-certs\""
Jul 23 16:28:50.190167 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.190136    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:28:50.304122 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.304328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.304328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.304328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304268    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4bnz\" (UniqueName: \"kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.304328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.304328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.304325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.404834 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4bnz\" (UniqueName: \"kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.404834 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404837    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405051 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405051 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405051 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405051 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.404964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405301 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.405276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405301 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.405290    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.405401 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.405356    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.407287 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.407262    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.407498 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.407484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.413135 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.413110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4bnz\" (UniqueName: \"kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz\") pod \"test-model-d1deea-kserve-6bdf64977c-9g2b6\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") " pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.491066 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.490964    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:28:50.626437 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.626408    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:28:50.629168 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:28:50.629126    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod428a4fbb_9917_4202_bb83_34f4773c04e1.slice/crio-1cd12875b2d752f28e875f41640f4b7340e09aead436af015c053b21830c2fe3 WatchSource:0}: Error finding container 1cd12875b2d752f28e875f41640f4b7340e09aead436af015c053b21830c2fe3: Status 404 returned error can't find the container with id 1cd12875b2d752f28e875f41640f4b7340e09aead436af015c053b21830c2fe3
Jul 23 16:28:50.683290 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:50.683250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" event={"ID":"428a4fbb-9917-4202-bb83-34f4773c04e1","Type":"ContainerStarted","Data":"1cd12875b2d752f28e875f41640f4b7340e09aead436af015c053b21830c2fe3"}
Jul 23 16:28:51.688994 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:51.688961    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" event={"ID":"428a4fbb-9917-4202-bb83-34f4773c04e1","Type":"ContainerStarted","Data":"83b56bd00168e0d8ad2511f2ea565655f00d424d72faa075cd26d29e4edb57d9"}
Jul 23 16:28:51.708381 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:51.708324    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" podStartSLOduration=1.708307024 podStartE2EDuration="1.708307024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:28:51.707261979 +0000 UTC m=+2312.830687779" watchObservedRunningTime="2026-07-23 16:28:51.708307024 +0000 UTC m=+2312.831732846"
Jul 23 16:28:54.590295 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:28:54.590246    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:29:00.492059 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:00.492018    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:00.492464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:00.492078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:00.504921 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:00.504890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:00.735391 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:00.735358    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:08.695986 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:08.695953    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:29:31.703982 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:31.703899    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:29:32.676217 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:32.676178    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:29:38.792387 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:38.792353    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:29:46.723995 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:46.723937    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" podUID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" containerName="main" containerID="cri-o://70cd6b2533904ec1e918fd98bae233ff52049f1ada4e1a3d6a876d41eff3abff" gracePeriod=45
Jul 23 16:29:46.921452 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:46.921419    2574 generic.go:356] "Generic (PLEG): container finished" podID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" containerID="70cd6b2533904ec1e918fd98bae233ff52049f1ada4e1a3d6a876d41eff3abff" exitCode=0
Jul 23 16:29:46.921650 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:46.921495    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" event={"ID":"203d3833-da2f-47ac-b6b2-1cc243ddb8dd","Type":"ContainerDied","Data":"70cd6b2533904ec1e918fd98bae233ff52049f1ada4e1a3d6a876d41eff3abff"}
Jul 23 16:29:46.972229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:46.972205    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:29:47.089149 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089120    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089196    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089231    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089247    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089269    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-488q8\" (UniqueName: \"kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8\") pod \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\" (UID: \"203d3833-da2f-47ac-b6b2-1cc243ddb8dd\") "
Jul 23 16:29:47.089630 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089475    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:47.089630 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089490    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:47.089630 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.089554    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home" (OuterVolumeSpecName: "home") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:47.091590 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.091568    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:29:47.091590 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.091582    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm" (OuterVolumeSpecName: "dshm") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:47.091703 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.091598    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8" (OuterVolumeSpecName: "kube-api-access-488q8") pod "203d3833-da2f-47ac-b6b2-1cc243ddb8dd" (UID: "203d3833-da2f-47ac-b6b2-1cc243ddb8dd"). InnerVolumeSpecName "kube-api-access-488q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:29:47.190378 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190341    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.190378 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190369    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.190378 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190378    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.190378 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190387    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.190671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190396    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.190671 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.190404    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-488q8\" (UniqueName: \"kubernetes.io/projected/203d3833-da2f-47ac-b6b2-1cc243ddb8dd-kube-api-access-488q8\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:47.696399 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.696287    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" podUID="428a4fbb-9917-4202-bb83-34f4773c04e1" containerName="main" containerID="cri-o://83b56bd00168e0d8ad2511f2ea565655f00d424d72faa075cd26d29e4edb57d9" gracePeriod=45
Jul 23 16:29:47.927594 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.927561    2574 generic.go:356] "Generic (PLEG): container finished" podID="428a4fbb-9917-4202-bb83-34f4773c04e1" containerID="83b56bd00168e0d8ad2511f2ea565655f00d424d72faa075cd26d29e4edb57d9" exitCode=0
Jul 23 16:29:47.928005 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.927634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" event={"ID":"428a4fbb-9917-4202-bb83-34f4773c04e1","Type":"ContainerDied","Data":"83b56bd00168e0d8ad2511f2ea565655f00d424d72faa075cd26d29e4edb57d9"}
Jul 23 16:29:47.929048 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.929024    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj" event={"ID":"203d3833-da2f-47ac-b6b2-1cc243ddb8dd","Type":"ContainerDied","Data":"76a592000a265df21a568e01fbb519a5589bdf90ea54937312d23eb271aaccfd"}
Jul 23 16:29:47.929152 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.929067    2574 scope.go:117] "RemoveContainer" containerID="70cd6b2533904ec1e918fd98bae233ff52049f1ada4e1a3d6a876d41eff3abff"
Jul 23 16:29:47.929152 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.929075    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"
Jul 23 16:29:47.951097 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.951074    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:47.960708 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.960678    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:29:47.965073 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:47.965039    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-652934/test-model-652934-kserve-6d7b774dc-fvjqj"]
Jul 23 16:29:48.097649 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097615    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.097851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097663    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.097851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097689    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.097851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097711    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4bnz\" (UniqueName: \"kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.097851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097746    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.097851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097794    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache\") pod \"428a4fbb-9917-4202-bb83-34f4773c04e1\" (UID: \"428a4fbb-9917-4202-bb83-34f4773c04e1\") "
Jul 23 16:29:48.098093 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097969    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home" (OuterVolumeSpecName: "home") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:48.098093 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.097980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:48.098192 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.098102    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:48.100054 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.100025    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:29:48.100054 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.100030    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz" (OuterVolumeSpecName: "kube-api-access-r4bnz") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "kube-api-access-r4bnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:29:48.100187 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.100085    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm" (OuterVolumeSpecName: "dshm") pod "428a4fbb-9917-4202-bb83-34f4773c04e1" (UID: "428a4fbb-9917-4202-bb83-34f4773c04e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198627    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198665    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198703    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198717    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4bnz\" (UniqueName: \"kubernetes.io/projected/428a4fbb-9917-4202-bb83-34f4773c04e1-kube-api-access-r4bnz\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198731    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428a4fbb-9917-4202-bb83-34f4773c04e1-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.198736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.198743    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/428a4fbb-9917-4202-bb83-34f4773c04e1-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:29:48.934607 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.934571    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"
Jul 23 16:29:48.934607 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.934594    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6" event={"ID":"428a4fbb-9917-4202-bb83-34f4773c04e1","Type":"ContainerDied","Data":"1cd12875b2d752f28e875f41640f4b7340e09aead436af015c053b21830c2fe3"}
Jul 23 16:29:48.935217 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.934653    2574 scope.go:117] "RemoveContainer" containerID="83b56bd00168e0d8ad2511f2ea565655f00d424d72faa075cd26d29e4edb57d9"
Jul 23 16:29:48.955870 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.955837    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:29:48.962735 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:48.962702    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d1deea/test-model-d1deea-kserve-6bdf64977c-9g2b6"]
Jul 23 16:29:49.394035 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:49.393995    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" path="/var/lib/kubelet/pods/203d3833-da2f-47ac-b6b2-1cc243ddb8dd/volumes"
Jul 23 16:29:49.394460 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:49.394441    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428a4fbb-9917-4202-bb83-34f4773c04e1" path="/var/lib/kubelet/pods/428a4fbb-9917-4202-bb83-34f4773c04e1/volumes"
Jul 23 16:29:49.441745 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:29:49.441716    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:30:08.483814 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:30:08.483776    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:30:27.688193 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:30:27.688155    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:30:42.485489 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:30:42.485400    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:30:59.190714 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:30:59.190674    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:31:27.396338 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:31:27.396302    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:31:45.994150 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:31:45.994113    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:31:57.287430 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:31:57.287395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:32:11.688821 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.688734    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689010    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428a4fbb-9917-4202-bb83-34f4773c04e1" containerName="main"
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689021    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="428a4fbb-9917-4202-bb83-34f4773c04e1" containerName="main"
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689034    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" containerName="main"
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689041    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" containerName="main"
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689097    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="428a4fbb-9917-4202-bb83-34f4773c04e1" containerName="main"
Jul 23 16:32:11.690955 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.689105    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="203d3833-da2f-47ac-b6b2-1cc243ddb8dd" containerName="main"
Jul 23 16:32:11.691733 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.691717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.694573 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.694550    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"openshift-service-ca.crt\""
Jul 23 16:32:11.695755 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.695724    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"kube-root-ca.crt\""
Jul 23 16:32:11.695915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.695843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"auth-test-model-9d26cd-kserve-self-signed-certs\""
Jul 23 16:32:11.695987 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.695869    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"default-dockercfg-zbsmp\""
Jul 23 16:32:11.702100 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.702076    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:32:11.770243 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.770436 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770270    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.770436 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770329    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.770436 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.770436 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.770639 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.770438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m74mx\" (UniqueName: \"kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871730 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871730 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m74mx\" (UniqueName: \"kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.871991 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.871851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.872197 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.872171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.872248 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.872198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.872248 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.872234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.874126 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.874099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.874435 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.874417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:11.880959 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:11.880934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m74mx\" (UniqueName: \"kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx\") pod \"auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") " pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:12.002813 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:12.002716    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:12.140827 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:12.140801    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:32:12.143242 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:32:12.143214    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd11c247_e4e4_40ee_a7c0_6ba92cb4377d.slice/crio-14d17959b3738562a92dab614012b8b7b92c3cbc4ef789b3a8e12f3393de8d62 WatchSource:0}: Error finding container 14d17959b3738562a92dab614012b8b7b92c3cbc4ef789b3a8e12f3393de8d62: Status 404 returned error can't find the container with id 14d17959b3738562a92dab614012b8b7b92c3cbc4ef789b3a8e12f3393de8d62
Jul 23 16:32:12.524343 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:12.524306    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" event={"ID":"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d","Type":"ContainerStarted","Data":"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"}
Jul 23 16:32:12.524343 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:12.524349    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" event={"ID":"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d","Type":"ContainerStarted","Data":"14d17959b3738562a92dab614012b8b7b92c3cbc4ef789b3a8e12f3393de8d62"}
Jul 23 16:32:12.545790 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:12.545734    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" podStartSLOduration=1.54571773 podStartE2EDuration="1.54571773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:32:12.543855662 +0000 UTC m=+2513.667281439" watchObservedRunningTime="2026-07-23 16:32:12.54571773 +0000 UTC m=+2513.669143532"
Jul 23 16:32:15.289545 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:15.289482    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:32:22.003106 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:22.003049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:22.003106 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:22.003119    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:22.015724 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:22.015700    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:22.579926 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:22.579888    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:32:33.206024 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.205993    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:32:33.209015 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.208997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.214373 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.213721    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"auth-test-model-ebb72a-kserve-self-signed-certs\""
Jul 23 16:32:33.214373 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.213424    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"default-dockercfg-q5mt7\""
Jul 23 16:32:33.214373 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.213795    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"kube-root-ca.crt\""
Jul 23 16:32:33.214373 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.214221    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"openshift-service-ca.crt\""
Jul 23 16:32:33.223010 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.222977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:32:33.246918 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.246884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.247118 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.246934    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.247118 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.246955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.247118 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.246980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.247118 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.247007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6h6\" (UniqueName: \"kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.247118 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.247028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348311 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348311 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348587 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348587 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6h6\" (UniqueName: \"kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348691 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348691 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348800 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348861 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.348942 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.348922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.350628 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.350603    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.350897 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.350881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.359103 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.359075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6h6\" (UniqueName: \"kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6\") pod \"auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") " pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.522015 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.521916    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:33.657936 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:33.657909    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:32:33.660481 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:32:33.660452    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod328a33d7_71ef_41f6_b379_1e3b46c344e0.slice/crio-fb87f72bb34b3ceed47c4f27d9afc56af8c594886f2e3bc771a925c2bf86508d WatchSource:0}: Error finding container fb87f72bb34b3ceed47c4f27d9afc56af8c594886f2e3bc771a925c2bf86508d: Status 404 returned error can't find the container with id fb87f72bb34b3ceed47c4f27d9afc56af8c594886f2e3bc771a925c2bf86508d
Jul 23 16:32:34.624028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:34.623991    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" event={"ID":"328a33d7-71ef-41f6-b379-1e3b46c344e0","Type":"ContainerStarted","Data":"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"}
Jul 23 16:32:34.624028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:34.624031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" event={"ID":"328a33d7-71ef-41f6-b379-1e3b46c344e0","Type":"ContainerStarted","Data":"fb87f72bb34b3ceed47c4f27d9afc56af8c594886f2e3bc771a925c2bf86508d"}
Jul 23 16:32:34.643349 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:34.643291    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" podStartSLOduration=1.6432732429999999 podStartE2EDuration="1.643273243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:32:34.641572167 +0000 UTC m=+2535.764997955" watchObservedRunningTime="2026-07-23 16:32:34.643273243 +0000 UTC m=+2535.766699017"
Jul 23 16:32:37.196306 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:37.196268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:32:43.522543 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:43.522495    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:43.522968 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:43.522558    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:43.534681 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:43.534647    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:43.672270 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:43.672242    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:32:55.394767 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:32:55.394731    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:33:06.387502 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:33:06.387466    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:33:26.231890 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:33:26.231854    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:33:45.400930 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:33:45.400845    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:34:05.694824 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:05.694780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:34:23.394441 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:23.394404    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:34:41.393901 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:41.393869    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:34:45.701250 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:45.701212    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:34:46.798972 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:46.798941    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:34:57.494002 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.493966    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:34:57.497296 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.497270    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.499975 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.499953    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"sub-test-model-9d26cd-kserve-self-signed-certs\""
Jul 23 16:34:57.508682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.508655    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:34:57.673608 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdcfb\" (UniqueName: \"kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.673809 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.673809 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.673809 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.673809 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673750    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.673809 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.673789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.774840 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.774840 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdcfb\" (UniqueName: \"kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775077 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775077 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775077 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775077 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.774941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775287 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.775136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775287 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.775202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.775382 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.775289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.777158 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.777134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.777377 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.777361    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.783514 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.783492    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdcfb\" (UniqueName: \"kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb\") pod \"sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") " pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.806706 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.806669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:34:57.940220 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:57.940187    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:34:57.943431 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:34:57.943400    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85d29514_9f23_42f1_a49e_1a29afa3688f.slice/crio-fa29655e01a2bbcafa575f6904baaef4652dcad91b3e073c719e76b903776498 WatchSource:0}: Error finding container fa29655e01a2bbcafa575f6904baaef4652dcad91b3e073c719e76b903776498: Status 404 returned error can't find the container with id fa29655e01a2bbcafa575f6904baaef4652dcad91b3e073c719e76b903776498
Jul 23 16:34:58.228275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:58.228236    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" event={"ID":"85d29514-9f23-42f1-a49e-1a29afa3688f","Type":"ContainerStarted","Data":"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"}
Jul 23 16:34:58.228275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:58.228276    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" event={"ID":"85d29514-9f23-42f1-a49e-1a29afa3688f","Type":"ContainerStarted","Data":"fa29655e01a2bbcafa575f6904baaef4652dcad91b3e073c719e76b903776498"}
Jul 23 16:34:58.247177 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:58.247124    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" podStartSLOduration=1.247106232 podStartE2EDuration="1.247106232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:34:58.246765897 +0000 UTC m=+2679.370191697" watchObservedRunningTime="2026-07-23 16:34:58.247106232 +0000 UTC m=+2679.370532006"
Jul 23 16:34:58.384590 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:34:58.384558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:35:01.195738 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.195691    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" podUID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" containerName="main" containerID="cri-o://a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85" gracePeriod=45
Jul 23 16:35:01.451311 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.451247    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:35:01.611472 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611429    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611683 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611491    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611683 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611507    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611683 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611557    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611782 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611749    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m74mx\" (UniqueName: \"kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611887 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611790    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir\") pod \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\" (UID: \"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d\") "
Jul 23 16:35:01.611887 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611810    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home" (OuterVolumeSpecName: "home") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:01.611887 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.611815    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:01.612040 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.612026    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.612040 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.612038    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.612148 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.612049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:01.613931 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.613901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx" (OuterVolumeSpecName: "kube-api-access-m74mx") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "kube-api-access-m74mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:35:01.614109 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.614084    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm" (OuterVolumeSpecName: "dshm") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:01.614202 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.614110    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" (UID: "fd11c247-e4e4-40ee-a7c0-6ba92cb4377d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:35:01.712631 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.712501    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.712631 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.712563    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.712631 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.712576    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m74mx\" (UniqueName: \"kubernetes.io/projected/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-kube-api-access-m74mx\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.712631 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.712587    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:01.821356 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:01.821318    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" podUID="328a33d7-71ef-41f6-b379-1e3b46c344e0" containerName="main" containerID="cri-o://57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d" gracePeriod=45
Jul 23 16:35:02.058872 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.058846    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:35:02.216783 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216750    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz6h6\" (UniqueName: \"kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216793    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216814    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216877    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216904    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.216934    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home\") pod \"328a33d7-71ef-41f6-b379-1e3b46c344e0\" (UID: \"328a33d7-71ef-41f6-b379-1e3b46c344e0\") "
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.217110    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:02.217229 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.217127    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:02.217502 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.217237    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home" (OuterVolumeSpecName: "home") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:02.219142 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.219113    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:35:02.219231 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.219125    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6" (OuterVolumeSpecName: "kube-api-access-wz6h6") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "kube-api-access-wz6h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:35:02.219231 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.219200    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm" (OuterVolumeSpecName: "dshm") pod "328a33d7-71ef-41f6-b379-1e3b46c344e0" (UID: "328a33d7-71ef-41f6-b379-1e3b46c344e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:35:02.245228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.245135    2574 generic.go:356] "Generic (PLEG): container finished" podID="328a33d7-71ef-41f6-b379-1e3b46c344e0" containerID="57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d" exitCode=0
Jul 23 16:35:02.245228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.245190    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"
Jul 23 16:35:02.245472 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.245224    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" event={"ID":"328a33d7-71ef-41f6-b379-1e3b46c344e0","Type":"ContainerDied","Data":"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"}
Jul 23 16:35:02.245472 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.245275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2" event={"ID":"328a33d7-71ef-41f6-b379-1e3b46c344e0","Type":"ContainerDied","Data":"fb87f72bb34b3ceed47c4f27d9afc56af8c594886f2e3bc771a925c2bf86508d"}
Jul 23 16:35:02.245472 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.245297    2574 scope.go:117] "RemoveContainer" containerID="57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"
Jul 23 16:35:02.246736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.246487    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" containerID="a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85" exitCode=0
Jul 23 16:35:02.246736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.246516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" event={"ID":"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d","Type":"ContainerDied","Data":"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"}
Jul 23 16:35:02.246736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.246558    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"
Jul 23 16:35:02.246736 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.246568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn" event={"ID":"fd11c247-e4e4-40ee-a7c0-6ba92cb4377d","Type":"ContainerDied","Data":"14d17959b3738562a92dab614012b8b7b92c3cbc4ef789b3a8e12f3393de8d62"}
Jul 23 16:35:02.253924 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.253904    2574 scope.go:117] "RemoveContainer" containerID="57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"
Jul 23 16:35:02.254211 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:35:02.254182    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d\": container with ID starting with 57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d not found: ID does not exist" containerID="57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"
Jul 23 16:35:02.254324 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.254219    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d"} err="failed to get container status \"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d\": rpc error: code = NotFound desc = could not find container \"57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d\": container with ID starting with 57202ebc499bd632d62804da13f02ae9543497d149b02735ca9fd7e4d642844d not found: ID does not exist"
Jul 23 16:35:02.254324 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.254242    2574 scope.go:117] "RemoveContainer" containerID="a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"
Jul 23 16:35:02.262196 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.262178    2574 scope.go:117] "RemoveContainer" containerID="a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"
Jul 23 16:35:02.262481 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:35:02.262461    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85\": container with ID starting with a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85 not found: ID does not exist" containerID="a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"
Jul 23 16:35:02.262599 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.262488    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85"} err="failed to get container status \"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85\": rpc error: code = NotFound desc = could not find container \"a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85\": container with ID starting with a57256213e7eb09d48b51f36ecc7da4d42f86eed99a597eb6564a5f417ddde85 not found: ID does not exist"
Jul 23 16:35:02.270403 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.270380    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:35:02.274189 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.274168    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/auth-test-model-ebb72a-kserve-d4d8ccf4c-7q8k2"]
Jul 23 16:35:02.285149 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.285119    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:35:02.290936 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.290910    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/auth-test-model-9d26cd-kserve-7fbbfbc547-2chgn"]
Jul 23 16:35:02.317718 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317687    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz6h6\" (UniqueName: \"kubernetes.io/projected/328a33d7-71ef-41f6-b379-1e3b46c344e0-kube-api-access-wz6h6\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:02.317718 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317714    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:02.317718 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317724    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:02.317909 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317733    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:02.317909 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317740    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328a33d7-71ef-41f6-b379-1e3b46c344e0-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:02.317909 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:02.317748    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328a33d7-71ef-41f6-b379-1e3b46c344e0-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:35:03.396834 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:03.396801    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="328a33d7-71ef-41f6-b379-1e3b46c344e0" path="/var/lib/kubelet/pods/328a33d7-71ef-41f6-b379-1e3b46c344e0/volumes"
Jul 23 16:35:03.397217 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:03.397174    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" path="/var/lib/kubelet/pods/fd11c247-e4e4-40ee-a7c0-6ba92cb4377d/volumes"
Jul 23 16:35:07.807230 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:07.807187    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:35:07.807724 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:07.807259    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:35:07.819680 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:07.819649    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:35:07.992596 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:07.992551    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:35:08.285654 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:08.285623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:35:16.603839 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.603751    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604049    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" containerName="main"
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604061    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" containerName="main"
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604085    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328a33d7-71ef-41f6-b379-1e3b46c344e0" containerName="main"
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604091    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="328a33d7-71ef-41f6-b379-1e3b46c344e0" containerName="main"
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604165    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd11c247-e4e4-40ee-a7c0-6ba92cb4377d" containerName="main"
Jul 23 16:35:16.604259 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.604176    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="328a33d7-71ef-41f6-b379-1e3b46c344e0" containerName="main"
Jul 23 16:35:16.608488 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.608457    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.611338 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.611315    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"kube-root-ca.crt\""
Jul 23 16:35:16.612418 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.612399    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"default-dockercfg-q5mt7\""
Jul 23 16:35:16.612571 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.612543    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"openshift-service-ca.crt\""
Jul 23 16:35:16.612571 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.612564    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"sub-test-model-ebb72a-kserve-self-signed-certs\""
Jul 23 16:35:16.617840 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.617815    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:35:16.625967 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.625929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.625967 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.625968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.626212 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.626021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.626212 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.626046    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.626212 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.626064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.626212 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.626119    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjp2d\" (UniqueName: \"kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.726950 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.726911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjp2d\" (UniqueName: \"kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727146 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.726969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727146 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727001    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727146 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727146 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727146 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727475 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727453    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727513 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.727513 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.727489    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.729458 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.729438    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.729677 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.729658    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.736358 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.736328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjp2d\" (UniqueName: \"kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d\") pod \"sub-test-model-ebb72a-kserve-774947ff97-kzbkc\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") " pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:16.921248 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:16.921132    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:17.061499 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:17.061466    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:35:17.064732 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:35:17.064706    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1c3f5d4_2fad_4764_8289_7dd6bb5b7f4a.slice/crio-47cf5ae3c27b86851d3da79704141f59e7f48dba831e10ed151bd4d2f15bd312 WatchSource:0}: Error finding container 47cf5ae3c27b86851d3da79704141f59e7f48dba831e10ed151bd4d2f15bd312: Status 404 returned error can't find the container with id 47cf5ae3c27b86851d3da79704141f59e7f48dba831e10ed151bd4d2f15bd312
Jul 23 16:35:17.313720 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:17.313629    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" event={"ID":"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a","Type":"ContainerStarted","Data":"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"}
Jul 23 16:35:17.313720 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:17.313674    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" event={"ID":"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a","Type":"ContainerStarted","Data":"47cf5ae3c27b86851d3da79704141f59e7f48dba831e10ed151bd4d2f15bd312"}
Jul 23 16:35:17.331578 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:17.331496    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" podStartSLOduration=1.331480976 podStartE2EDuration="1.331480976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:35:17.330358109 +0000 UTC m=+2698.453783898" watchObservedRunningTime="2026-07-23 16:35:17.331480976 +0000 UTC m=+2698.454906751"
Jul 23 16:35:20.196449 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:20.196412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:35:26.921337 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:26.921293    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:26.921852 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:26.921355    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:26.933600 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:26.933572    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:27.368727 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:27.368690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:35:34.297318 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:34.297281    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:35:52.839264 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:52.839222    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:35:59.108938 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:35:59.108897    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:36:00.080053 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:00.080015    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:36:09.394284 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.394246    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:36:09.397147 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.397131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.399972 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.399950    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d26cd\"/\"rate-test-model-9d26cd-kserve-self-signed-certs\""
Jul 23 16:36:09.406733 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.406707    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:36:09.551621 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.551825 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551630    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttm4\" (UniqueName: \"kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.551825 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.551825 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.551825 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.551825 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.551737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652635 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652543    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652635 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652582    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652635 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652905 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttm4\" (UniqueName: \"kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652905 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.652905 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.652699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.653058 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.653023    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.653058 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.653042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.653130 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.653091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.654950 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.654931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.655212 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.655193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.662005 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.661982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttm4\" (UniqueName: \"kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4\") pod \"rate-test-model-9d26cd-kserve-554fc6656c-5fcc9\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") " pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.707174 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.707131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:09.844762 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:09.844724    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:36:09.847958 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:36:09.847917    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3155d34_9167_4fc5_8905_831c91a44c6c.slice/crio-d3c4e116cf1062940a19399dfae986e851cf40684ae023d5aca083864b640764 WatchSource:0}: Error finding container d3c4e116cf1062940a19399dfae986e851cf40684ae023d5aca083864b640764: Status 404 returned error can't find the container with id d3c4e116cf1062940a19399dfae986e851cf40684ae023d5aca083864b640764
Jul 23 16:36:10.532033 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:10.531987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" event={"ID":"c3155d34-9167-4fc5-8905-831c91a44c6c","Type":"ContainerStarted","Data":"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"}
Jul 23 16:36:10.532033 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:10.532037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" event={"ID":"c3155d34-9167-4fc5-8905-831c91a44c6c","Type":"ContainerStarted","Data":"d3c4e116cf1062940a19399dfae986e851cf40684ae023d5aca083864b640764"}
Jul 23 16:36:10.551345 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:10.551287    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" podStartSLOduration=1.551271496 podStartE2EDuration="1.551271496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:36:10.549940698 +0000 UTC m=+2751.673366475" watchObservedRunningTime="2026-07-23 16:36:10.551271496 +0000 UTC m=+2751.674697272"
Jul 23 16:36:13.187539 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:13.187481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:36:14.128690 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.128644    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" podUID="85d29514-9f23-42f1-a49e-1a29afa3688f" containerName="main" containerID="cri-o://553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410" gracePeriod=45
Jul 23 16:36:14.382464 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.382396    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:36:14.496957 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.496915    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdcfb\" (UniqueName: \"kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.496957 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.496965    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.497223 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.496987    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.497223 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497009    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.497223 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497126    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.497223 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497158    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home\") pod \"85d29514-9f23-42f1-a49e-1a29afa3688f\" (UID: \"85d29514-9f23-42f1-a49e-1a29afa3688f\") "
Jul 23 16:36:14.497438 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497254    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache" (OuterVolumeSpecName: "model-cache") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:14.497438 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497266    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:14.497569 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497472    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home" (OuterVolumeSpecName: "home") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:14.497569 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497553    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:14.497682 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.497571    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:14.499172 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.499146    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm" (OuterVolumeSpecName: "dshm") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:14.499302 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.499206    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:36:14.499302 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.499258    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb" (OuterVolumeSpecName: "kube-api-access-mdcfb") pod "85d29514-9f23-42f1-a49e-1a29afa3688f" (UID: "85d29514-9f23-42f1-a49e-1a29afa3688f"). InnerVolumeSpecName "kube-api-access-mdcfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:36:14.549961 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.549921    2574 generic.go:356] "Generic (PLEG): container finished" podID="85d29514-9f23-42f1-a49e-1a29afa3688f" containerID="553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410" exitCode=0
Jul 23 16:36:14.550125 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.549969    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"
Jul 23 16:36:14.550125 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.550005    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" event={"ID":"85d29514-9f23-42f1-a49e-1a29afa3688f","Type":"ContainerDied","Data":"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"}
Jul 23 16:36:14.550125 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.550064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn" event={"ID":"85d29514-9f23-42f1-a49e-1a29afa3688f","Type":"ContainerDied","Data":"fa29655e01a2bbcafa575f6904baaef4652dcad91b3e073c719e76b903776498"}
Jul 23 16:36:14.550125 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.550081    2574 scope.go:117] "RemoveContainer" containerID="553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"
Jul 23 16:36:14.558616 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.558595    2574 scope.go:117] "RemoveContainer" containerID="553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"
Jul 23 16:36:14.558895 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:36:14.558877    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410\": container with ID starting with 553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410 not found: ID does not exist" containerID="553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"
Jul 23 16:36:14.558935 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.558907    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410"} err="failed to get container status \"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410\": rpc error: code = NotFound desc = could not find container \"553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410\": container with ID starting with 553f612124ccf371342b67d5d16e4695b54b0e0d114b3fc1448c7c0e451e0410 not found: ID does not exist"
Jul 23 16:36:14.575703 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.575669    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:36:14.588052 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.588023    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/sub-test-model-9d26cd-kserve-7db7bd579f-wzhpn"]
Jul 23 16:36:14.598947 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.598920    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d29514-9f23-42f1-a49e-1a29afa3688f-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:14.598947 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.598948    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:14.599104 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.598958    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d29514-9f23-42f1-a49e-1a29afa3688f-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:14.599104 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:14.598966    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdcfb\" (UniqueName: \"kubernetes.io/projected/85d29514-9f23-42f1-a49e-1a29afa3688f-kube-api-access-mdcfb\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.100886 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.100825    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" podUID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" containerName="main" containerID="cri-o://cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84" gracePeriod=45
Jul 23 16:36:15.346542 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.346499    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:36:15.393550 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.393437    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d29514-9f23-42f1-a49e-1a29afa3688f" path="/var/lib/kubelet/pods/85d29514-9f23-42f1-a49e-1a29afa3688f/volumes"
Jul 23 16:36:15.506868 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.506829    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507060 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.506881    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjp2d\" (UniqueName: \"kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507060 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.506915    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507060 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507082    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507122    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache\") pod \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\" (UID: \"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a\") "
Jul 23 16:36:15.507228 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507210    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home" (OuterVolumeSpecName: "home") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:15.507410 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507391    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.507469 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507412    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:15.507606 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.507585    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:15.509231 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.509194    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d" (OuterVolumeSpecName: "kube-api-access-jjp2d") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "kube-api-access-jjp2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:36:15.509231 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.509222    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:36:15.509458 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.509440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm" (OuterVolumeSpecName: "dshm") pod "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" (UID: "b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:36:15.556471 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.556433    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" containerID="cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84" exitCode=0
Jul 23 16:36:15.556646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.556491    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"
Jul 23 16:36:15.556646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.556513    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" event={"ID":"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a","Type":"ContainerDied","Data":"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"}
Jul 23 16:36:15.556646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.556590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc" event={"ID":"b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a","Type":"ContainerDied","Data":"47cf5ae3c27b86851d3da79704141f59e7f48dba831e10ed151bd4d2f15bd312"}
Jul 23 16:36:15.556646 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.556610    2574 scope.go:117] "RemoveContainer" containerID="cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"
Jul 23 16:36:15.565457 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.565434    2574 scope.go:117] "RemoveContainer" containerID="cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"
Jul 23 16:36:15.565752 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:36:15.565732    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84\": container with ID starting with cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84 not found: ID does not exist" containerID="cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"
Jul 23 16:36:15.565811 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.565763    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84"} err="failed to get container status \"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84\": rpc error: code = NotFound desc = could not find container \"cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84\": container with ID starting with cd470195e5a70a64b9dd808508f42cd7c3693e30ac3bafaf9d919e5a5d92fb84 not found: ID does not exist"
Jul 23 16:36:15.578019 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.577987    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:36:15.582454 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.582426    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/sub-test-model-ebb72a-kserve-774947ff97-kzbkc"]
Jul 23 16:36:15.608537 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.608501    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.608686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.608576    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.608686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.608586    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjp2d\" (UniqueName: \"kubernetes.io/projected/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-kube-api-access-jjp2d\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.608686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.608600    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:15.608686 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:15.608610    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:36:17.393812 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:17.393778    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" path="/var/lib/kubelet/pods/b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a/volumes"
Jul 23 16:36:19.707906 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:19.707867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:19.707906 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:19.707913    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:19.720470 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:19.720439    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:20.588867 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:20.588839    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:36:44.896505 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896433    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896794    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d29514-9f23-42f1-a49e-1a29afa3688f" containerName="main"
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896808    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d29514-9f23-42f1-a49e-1a29afa3688f" containerName="main"
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896819    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" containerName="main"
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896824    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" containerName="main"
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896892    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d29514-9f23-42f1-a49e-1a29afa3688f" containerName="main"
Jul 23 16:36:44.896954 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.896901    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c3f5d4-2fad-4764-8289-7dd6bb5b7f4a" containerName="main"
Jul 23 16:36:44.899968 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.899940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.902841 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.902818    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"default-dockercfg-q5mt7\""
Jul 23 16:36:44.904249 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.904225    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"kube-root-ca.crt\""
Jul 23 16:36:44.904380 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.904237    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"openshift-service-ca.crt\""
Jul 23 16:36:44.904380 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.904268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ebb72a\"/\"rate-test-model-ebb72a-kserve-self-signed-certs\""
Jul 23 16:36:44.916471 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.916443    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:36:44.952274 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952228    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.952274 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44stb\" (UniqueName: \"kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.952562 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.952562 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.952562 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952464    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:44.952562 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:44.952496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053275 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053576 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053576 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44stb\" (UniqueName: \"kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053576 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053576 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053795 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053739    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053795 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.053890 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.053836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.055651 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.055631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.055799 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.055781    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.063933 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.063910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44stb\" (UniqueName: \"kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb\") pod \"rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") " pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.209030 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.208931    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:45.343679 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.343652    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:36:45.346273 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:36:45.346242    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75c04e2_172b_4006_aba1_75fd032292d3.slice/crio-1f5139ccd834ad9d38c3a542b2b52d72236a50dcb6c8ed505248a5c74481c7d3 WatchSource:0}: Error finding container 1f5139ccd834ad9d38c3a542b2b52d72236a50dcb6c8ed505248a5c74481c7d3: Status 404 returned error can't find the container with id 1f5139ccd834ad9d38c3a542b2b52d72236a50dcb6c8ed505248a5c74481c7d3
Jul 23 16:36:45.677546 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.677491    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" event={"ID":"c75c04e2-172b-4006-aba1-75fd032292d3","Type":"ContainerStarted","Data":"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"}
Jul 23 16:36:45.677723 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.677555    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" event={"ID":"c75c04e2-172b-4006-aba1-75fd032292d3","Type":"ContainerStarted","Data":"1f5139ccd834ad9d38c3a542b2b52d72236a50dcb6c8ed505248a5c74481c7d3"}
Jul 23 16:36:45.695417 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:45.695364    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" podStartSLOduration=1.69534917 podStartE2EDuration="1.69534917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:36:45.693893067 +0000 UTC m=+2786.817318841" watchObservedRunningTime="2026-07-23 16:36:45.69534917 +0000 UTC m=+2786.818774944"
Jul 23 16:36:48.589911 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:48.589875    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:36:55.209618 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:55.209566    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:55.209618 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:55.209631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:55.222437 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:55.222407    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:36:55.730426 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:36:55.730381    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:37:03.597617 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:03.597581    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:37:19.501538 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:19.501480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:37:27.274400 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:27.274364    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:37:28.187627 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:28.187592    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:37:34.189457 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:34.189420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:37:42.294282 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.294238    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" podUID="c3155d34-9167-4fc5-8905-831c91a44c6c" containerName="main" containerID="cri-o://84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d" gracePeriod=45
Jul 23 16:37:42.546028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.545969    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:37:42.655983 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.655949    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.655983 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.655987    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lttm4\" (UniqueName: \"kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.656234 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.656234 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.656234 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656068    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.656234 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir\") pod \"c3155d34-9167-4fc5-8905-831c91a44c6c\" (UID: \"c3155d34-9167-4fc5-8905-831c91a44c6c\") "
Jul 23 16:37:42.656433 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656329    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:42.656433 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656345    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home" (OuterVolumeSpecName: "home") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:42.656511 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:42.656511 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656502    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.656635 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.656616    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.658240 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.658216    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:37:42.658628 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.658606    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm" (OuterVolumeSpecName: "dshm") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:42.658697 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.658633    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4" (OuterVolumeSpecName: "kube-api-access-lttm4") pod "c3155d34-9167-4fc5-8905-831c91a44c6c" (UID: "c3155d34-9167-4fc5-8905-831c91a44c6c"). InnerVolumeSpecName "kube-api-access-lttm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:42.757650 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.757611    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.757650 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.757641    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lttm4\" (UniqueName: \"kubernetes.io/projected/c3155d34-9167-4fc5-8905-831c91a44c6c-kube-api-access-lttm4\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.757650 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.757653    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3155d34-9167-4fc5-8905-831c91a44c6c-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.757650 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.757661    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3155d34-9167-4fc5-8905-831c91a44c6c-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:42.916876 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.916810    2574 generic.go:356] "Generic (PLEG): container finished" podID="c3155d34-9167-4fc5-8905-831c91a44c6c" containerID="84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d" exitCode=0
Jul 23 16:37:42.916876 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.916853    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"
Jul 23 16:37:42.917089 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.916896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" event={"ID":"c3155d34-9167-4fc5-8905-831c91a44c6c","Type":"ContainerDied","Data":"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"}
Jul 23 16:37:42.917089 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.916944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9" event={"ID":"c3155d34-9167-4fc5-8905-831c91a44c6c","Type":"ContainerDied","Data":"d3c4e116cf1062940a19399dfae986e851cf40684ae023d5aca083864b640764"}
Jul 23 16:37:42.917089 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.916963    2574 scope.go:117] "RemoveContainer" containerID="84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"
Jul 23 16:37:42.926417 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.926399    2574 scope.go:117] "RemoveContainer" containerID="84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"
Jul 23 16:37:42.926744 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:37:42.926724    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d\": container with ID starting with 84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d not found: ID does not exist" containerID="84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"
Jul 23 16:37:42.926804 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.926755    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d"} err="failed to get container status \"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d\": rpc error: code = NotFound desc = could not find container \"84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d\": container with ID starting with 84b0455d28b0157525739a6189222414e5eea133c200a14251bd7d66a80c5b0d not found: ID does not exist"
Jul 23 16:37:42.937942 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.937909    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:37:42.939893 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:42.939858    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9d26cd/rate-test-model-9d26cd-kserve-554fc6656c-5fcc9"]
Jul 23 16:37:43.207956 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.207849    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" podUID="c75c04e2-172b-4006-aba1-75fd032292d3" containerName="main" containerID="cri-o://e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717" gracePeriod=45
Jul 23 16:37:43.396453 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.396415    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3155d34-9167-4fc5-8905-831c91a44c6c" path="/var/lib/kubelet/pods/c3155d34-9167-4fc5-8905-831c91a44c6c/volumes"
Jul 23 16:37:43.452111 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.452087    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:37:43.564851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564750    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.564851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44stb\" (UniqueName: \"kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.564851 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564832    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.565136 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.565136 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564883    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.565136 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.564916    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home\") pod \"c75c04e2-172b-4006-aba1-75fd032292d3\" (UID: \"c75c04e2-172b-4006-aba1-75fd032292d3\") "
Jul 23 16:37:43.565136 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.565106    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:43.565342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.565146    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache" (OuterVolumeSpecName: "model-cache") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:43.565342 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.565219    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home" (OuterVolumeSpecName: "home") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:43.566994 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.566966    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm" (OuterVolumeSpecName: "dshm") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:37:43.567102 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.567032    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb" (OuterVolumeSpecName: "kube-api-access-44stb") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "kube-api-access-44stb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:43.567102 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.567071    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c75c04e2-172b-4006-aba1-75fd032292d3" (UID: "c75c04e2-172b-4006-aba1-75fd032292d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:37:43.666363 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666306    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-tmp-dir\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.666363 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666357    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44stb\" (UniqueName: \"kubernetes.io/projected/c75c04e2-172b-4006-aba1-75fd032292d3-kube-api-access-44stb\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.666363 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666368    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-model-cache\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.666363 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666376    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-dshm\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.666363 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666385    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c75c04e2-172b-4006-aba1-75fd032292d3-tls-certs\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.666727 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.666393    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c75c04e2-172b-4006-aba1-75fd032292d3-home\") on node \"ip-10-0-130-166.ec2.internal\" DevicePath \"\""
Jul 23 16:37:43.923097 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.923064    2574 generic.go:356] "Generic (PLEG): container finished" podID="c75c04e2-172b-4006-aba1-75fd032292d3" containerID="e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717" exitCode=0
Jul 23 16:37:43.923326 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.923103    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"
Jul 23 16:37:43.923326 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.923123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" event={"ID":"c75c04e2-172b-4006-aba1-75fd032292d3","Type":"ContainerDied","Data":"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"}
Jul 23 16:37:43.923326 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.923155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6" event={"ID":"c75c04e2-172b-4006-aba1-75fd032292d3","Type":"ContainerDied","Data":"1f5139ccd834ad9d38c3a542b2b52d72236a50dcb6c8ed505248a5c74481c7d3"}
Jul 23 16:37:43.923326 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.923171    2574 scope.go:117] "RemoveContainer" containerID="e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"
Jul 23 16:37:43.931899 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.931880    2574 scope.go:117] "RemoveContainer" containerID="e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"
Jul 23 16:37:43.932209 ip-10-0-130-166 kubenswrapper[2574]: E0723 16:37:43.932185    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717\": container with ID starting with e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717 not found: ID does not exist" containerID="e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"
Jul 23 16:37:43.932256 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.932220    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717"} err="failed to get container status \"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717\": rpc error: code = NotFound desc = could not find container \"e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717\": container with ID starting with e833fc153f4d83a3e3fa7574cd0d1e38db837f6b74416fa250c9d8bfcc90c717 not found: ID does not exist"
Jul 23 16:37:43.943384 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.943340    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:37:43.944992 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:43.944967    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ebb72a/rate-test-model-ebb72a-kserve-ff47cfd55-x8cz6"]
Jul 23 16:37:45.395317 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:37:45.395278    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75c04e2-172b-4006-aba1-75fd032292d3" path="/var/lib/kubelet/pods/c75c04e2-172b-4006-aba1-75fd032292d3/volumes"
Jul 23 16:38:01.490289 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:01.490254    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:38:23.592574 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:23.592539    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8sqk"]
Jul 23 16:38:32.725979 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:32.725942    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76d9d7c949-npwnw_e7bb0efd-f777-4306-be9e-fbe3f818ea23/authorino/0.log"
Jul 23 16:38:39.185719 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:39.185688    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-qzk6f_e2ab2310-75da-4c11-90a9-a583c2d60b19/copy-manifests/0.log"
Jul 23 16:38:39.193075 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:39.193037    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-qzk6f_e2ab2310-75da-4c11-90a9-a583c2d60b19/manager/0.log"
Jul 23 16:38:41.407298 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:41.407259    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76d9d7c949-npwnw_e7bb0efd-f777-4306-be9e-fbe3f818ea23/authorino/0.log"
Jul 23 16:38:42.161634 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:42.161598    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8sqk_9ee7a983-0805-4ac4-991a-4d8b1d5b8b72/limitador/0.log"
Jul 23 16:38:42.915028 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:42.914991    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-p2gvf_a258df90-2cd6-4429-a1fe-fe18ef293db8/kube-auth-proxy/0.log"
Jul 23 16:38:44.412273 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:44.412241    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zgvd4_b921fcae-af2a-4706-8b7f-bef0117e9e62/main/0.log"
Jul 23 16:38:44.531328 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:44.531297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-qgtf2_74215a16-fc21-43b1-84d3-4d68eb991b78/main/0.log"
Jul 23 16:38:53.314122 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:53.314090    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jw7tl_6b279901-b871-4d03-bb9e-bc748a79447d/global-pull-secret-syncer/0.log"
Jul 23 16:38:53.490056 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:53.490023    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qlbc8_83410180-155f-4b82-ae5c-3d26d679a145/konnectivity-agent/0.log"
Jul 23 16:38:53.516136 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:53.516107    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-166.ec2.internal_a4f18a4042ac0c4f669794ed57bc7586/haproxy/0.log"
Jul 23 16:38:59.374727 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:59.374678    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76d9d7c949-npwnw_e7bb0efd-f777-4306-be9e-fbe3f818ea23/authorino/0.log"
Jul 23 16:38:59.772640 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:38:59.772557    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8sqk_9ee7a983-0805-4ac4-991a-4d8b1d5b8b72/limitador/0.log"
Jul 23 16:39:01.927606 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:01.927578    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mrjg_3b9f3847-2efc-4676-adfa-5590a792a5e0/node-exporter/0.log"
Jul 23 16:39:01.950593 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:01.950568    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mrjg_3b9f3847-2efc-4676-adfa-5590a792a5e0/kube-rbac-proxy/0.log"
Jul 23 16:39:01.972187 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:01.972164    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9mrjg_3b9f3847-2efc-4676-adfa-5590a792a5e0/init-textfile/0.log"
Jul 23 16:39:06.603863 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.603827    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56rlr_d6525e36-7b23-4467-9914-f15b11c1e1af/dns/0.log"
Jul 23 16:39:06.639419 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.639391    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56rlr_d6525e36-7b23-4467-9914-f15b11c1e1af/kube-rbac-proxy/0.log"
Jul 23 16:39:06.848635 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.848603    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8vhn5_df8d355f-b264-4118-8a8d-f6000315b61f/dns-node-resolver/0.log"
Jul 23 16:39:06.958613 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958530    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"]
Jul 23 16:39:06.958850 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958838    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75c04e2-172b-4006-aba1-75fd032292d3" containerName="main"
Jul 23 16:39:06.958890 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958852    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75c04e2-172b-4006-aba1-75fd032292d3" containerName="main"
Jul 23 16:39:06.958890 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958864    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3155d34-9167-4fc5-8905-831c91a44c6c" containerName="main"
Jul 23 16:39:06.958890 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958870    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3155d34-9167-4fc5-8905-831c91a44c6c" containerName="main"
Jul 23 16:39:06.958980 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958916    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3155d34-9167-4fc5-8905-831c91a44c6c" containerName="main"
Jul 23 16:39:06.958980 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.958923    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75c04e2-172b-4006-aba1-75fd032292d3" containerName="main"
Jul 23 16:39:06.961977 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.961954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:06.964986 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.964963    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l5zs\"/\"kube-root-ca.crt\""
Jul 23 16:39:06.966063 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.966041    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l5zs\"/\"default-dockercfg-ncpq6\""
Jul 23 16:39:06.966171 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.966065    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l5zs\"/\"openshift-service-ca.crt\""
Jul 23 16:39:06.975800 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:06.975773    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"]
Jul 23 16:39:07.149312 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.149276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq62l\" (UniqueName: \"kubernetes.io/projected/801cab4d-2560-45ac-a37a-44b520e23c41-kube-api-access-bq62l\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.149312 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.149316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-sys\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.149556 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.149349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-lib-modules\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.149556 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.149423    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-proc\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.149556 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.149468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-podres\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250697 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-podres\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250697 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq62l\" (UniqueName: \"kubernetes.io/projected/801cab4d-2560-45ac-a37a-44b520e23c41-kube-api-access-bq62l\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250697 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250688    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-sys\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-lib-modules\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-proc\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-podres\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-sys\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250834    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-proc\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.250915 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.250876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/801cab4d-2560-45ac-a37a-44b520e23c41-lib-modules\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.261354 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.261324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq62l\" (UniqueName: \"kubernetes.io/projected/801cab4d-2560-45ac-a37a-44b520e23c41-kube-api-access-bq62l\") pod \"perf-node-gather-daemonset-55csx\" (UID: \"801cab4d-2560-45ac-a37a-44b520e23c41\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.271506 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.271475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:07.406950 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.406924    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"]
Jul 23 16:39:07.409154 ip-10-0-130-166 kubenswrapper[2574]: W0723 16:39:07.409124    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod801cab4d_2560_45ac_a37a_44b520e23c41.slice/crio-3033b641fa0297648d7a41f61386affb78fd21076424f1141ddd01a945b6ee5d WatchSource:0}: Error finding container 3033b641fa0297648d7a41f61386affb78fd21076424f1141ddd01a945b6ee5d: Status 404 returned error can't find the container with id 3033b641fa0297648d7a41f61386affb78fd21076424f1141ddd01a945b6ee5d
Jul 23 16:39:07.626365 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:07.626337    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sdcvj_e5fc243a-468d-4c61-bf9a-2d0656f4e83a/node-ca/0.log"
Jul 23 16:39:08.268049 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:08.268013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx" event={"ID":"801cab4d-2560-45ac-a37a-44b520e23c41","Type":"ContainerStarted","Data":"a2e3fa6070619e2b08ca7fb250ec60f91151c49ad514a77703412d464a92b97d"}
Jul 23 16:39:08.268248 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:08.268062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx" event={"ID":"801cab4d-2560-45ac-a37a-44b520e23c41","Type":"ContainerStarted","Data":"3033b641fa0297648d7a41f61386affb78fd21076424f1141ddd01a945b6ee5d"}
Jul 23 16:39:08.268248 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:08.268108    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:08.285183 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:08.285129    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx" podStartSLOduration=2.285110384 podStartE2EDuration="2.285110384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:39:08.283338542 +0000 UTC m=+2929.406764317" watchObservedRunningTime="2026-07-23 16:39:08.285110384 +0000 UTC m=+2929.408536185"
Jul 23 16:39:08.760701 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:08.760664    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-p2gvf_a258df90-2cd6-4429-a1fe-fe18ef293db8/kube-auth-proxy/0.log"
Jul 23 16:39:09.695027 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:09.694993    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwsbr_41f62dd0-2dcc-4940-b697-c760e19e4c7b/serve-healthcheck-canary/0.log"
Jul 23 16:39:10.251271 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:10.251241    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpf2t_24b086ab-ccfa-44fe-9a54-18fdba44b37f/kube-rbac-proxy/0.log"
Jul 23 16:39:10.272836 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:10.272805    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpf2t_24b086ab-ccfa-44fe-9a54-18fdba44b37f/exporter/0.log"
Jul 23 16:39:10.296221 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:10.296183    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dpf2t_24b086ab-ccfa-44fe-9a54-18fdba44b37f/extractor/0.log"
Jul 23 16:39:13.506842 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:13.506811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-qzk6f_e2ab2310-75da-4c11-90a9-a583c2d60b19/manager/0.log"
Jul 23 16:39:13.527916 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:13.527887    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-qzk6f_e2ab2310-75da-4c11-90a9-a583c2d60b19/copy-manifests/0.log"
Jul 23 16:39:14.260260 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:14.260227    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-p2gvf_a258df90-2cd6-4429-a1fe-fe18ef293db8/kube-auth-proxy/0.log"
Jul 23 16:39:14.282961 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:14.282935    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-55csx"
Jul 23 16:39:14.793424 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:14.793395    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-775bb6b8db-hqvcj_742e6d39-7bd2-4242-80e7-97885bb221ca/manager/0.log"
Jul 23 16:39:14.817969 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:14.817940    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gsj9t_d98b9de9-5c85-405d-a344-622015e7bbe9/openshift-lws-operator/0.log"
Jul 23 16:39:15.745897 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:15.745865    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-p2gvf_a258df90-2cd6-4429-a1fe-fe18ef293db8/kube-auth-proxy/0.log"
Jul 23 16:39:20.134239 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:20.134205    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dr9lh_774d42e6-9662-4690-b50b-ca3b124a9647/migrator/0.log"
Jul 23 16:39:20.159804 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:20.159768    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dr9lh_774d42e6-9662-4690-b50b-ca3b124a9647/graceful-termination/0.log"
Jul 23 16:39:21.656884 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.656853    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/kube-multus-additional-cni-plugins/0.log"
Jul 23 16:39:21.677207 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.677162    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/egress-router-binary-copy/0.log"
Jul 23 16:39:21.698499 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.698473    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/cni-plugins/0.log"
Jul 23 16:39:21.719534 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.719487    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/bond-cni-plugin/0.log"
Jul 23 16:39:21.746924 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.746894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/routeoverride-cni/0.log"
Jul 23 16:39:21.773575 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.769725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/whereabouts-cni-bincopy/0.log"
Jul 23 16:39:21.793989 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:21.793921    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5r9pt_e0c9d05a-e1ac-4222-ad57-ff1f57efec57/whereabouts-cni/0.log"
Jul 23 16:39:22.178219 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:22.178187    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t9jwr_a80322fc-74e7-4ffb-8e51-3333c3bd9d9f/kube-multus/0.log"
Jul 23 16:39:22.200166 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:22.200132    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2t5t4_81b71535-fc29-44c1-a128-1b781e38b209/network-metrics-daemon/0.log"
Jul 23 16:39:22.219793 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:22.219761    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2t5t4_81b71535-fc29-44c1-a128-1b781e38b209/kube-rbac-proxy/0.log"
Jul 23 16:39:23.673168 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.673135    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/ovn-controller/0.log"
Jul 23 16:39:23.689200 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.689172    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/ovn-acl-logging/0.log"
Jul 23 16:39:23.716438 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.716392    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/kube-rbac-proxy-node/0.log"
Jul 23 16:39:23.738260 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.738206    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/kube-rbac-proxy-ovn-metrics/0.log"
Jul 23 16:39:23.759132 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.759101    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/northd/0.log"
Jul 23 16:39:23.779210 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.779176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/nbdb/0.log"
Jul 23 16:39:23.798913 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.798885    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/sbdb/0.log"
Jul 23 16:39:23.878591 ip-10-0-130-166 kubenswrapper[2574]: I0723 16:39:23.878556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nw9cp_4a26b29a-0e7f-4c06-b381-db0f6eb8a7be/ovnkube-controller/0.log"